-- Logs begin at Tue 2022-08-30 14:01:26 UTC, end at Tue 2022-08-30 15:12:03 UTC. -- Aug 30 14:36:03.883792 dv-cinder-828807-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 14:36:03.892740 dv-cinder-828807-5-smb devstack@keystone.service[93225]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:36:03 2022] *** Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: nodename: dv-cinder-828807-5-smb Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: machine: x86_64 Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: clock source: unix Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: pcre jit disabled Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: detected number of CPU cores: 4 Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: current working directory: / Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:36:03.894765 dv-cinder-828807-5-smb devstack@keystone.service[93225]: your processes number limit is 47680 Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: your memory page size is 4096 bytes Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: detected max file descriptor number: 2048 Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: lock engine: pthread robust mutexes Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: thunder lock: enabled Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 14:36:03.895379 dv-cinder-828807-5-smb devstack@keystone.service[93225]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:36:03.936164 dv-cinder-828807-5-smb devstack@keystone.service[93225]: Python main interpreter initialized at 0x5633333ee9c0 Aug 30 14:36:03.936164 dv-cinder-828807-5-smb devstack@keystone.service[93225]: python threads support enabled Aug 30 14:36:03.936164 dv-cinder-828807-5-smb devstack@keystone.service[93225]: your server socket listen backlog is limited to 100 connections Aug 30 14:36:03.936164 dv-cinder-828807-5-smb devstack@keystone.service[93225]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:36:03.936504 dv-cinder-828807-5-smb devstack@keystone.service[93225]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:36:03.936587 dv-cinder-828807-5-smb devstack@keystone.service[93225]: *** Operational MODE: preforking *** Aug 30 14:36:03.936861 dv-cinder-828807-5-smb devstack@keystone.service[93225]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:36:03.936861 dv-cinder-828807-5-smb devstack@keystone.service[93225]: spawned uWSGI master process (pid: 93225) Aug 30 14:36:03.937063 dv-cinder-828807-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 14:36:03.940883 dv-cinder-828807-5-smb devstack@keystone.service[93225]: spawned uWSGI worker 1 (pid: 93237, cores: 1) Aug 30 14:36:03.940883 dv-cinder-828807-5-smb devstack@keystone.service[93225]: spawned uWSGI worker 2 (pid: 93238, cores: 1) Aug 30 14:36:03.940883 dv-cinder-828807-5-smb devstack@keystone.service[93225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:36:08.286670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:36:08.286670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: from cryptography.utils import int_from_bytes Aug 30 14:36:08.287452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:36:08.287452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: from cryptography.utils import int_from_bytes Aug 30 14:36:08.291097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:36:08.291097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: from cryptography.utils import int_from_bytes Aug 30 14:36:08.293983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:36:08.293983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: from cryptography.utils import int_from_bytes Aug 30 14:36:08.337913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:36:08.338097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:36:08.338275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] command line args: [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:36:08.338539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:36:08.338716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ================================================================================ {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:36:08.338966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] admin_token = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.339084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:36:08.339207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] config_dir = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.339296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:36:08.339391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.339475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] command line args: [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:36:08.339573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] config_source = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.339725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:36:08.339804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] debug = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.339886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ================================================================================ {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:36:08.340558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.340975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] admin_token = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.340975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] config_dir = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] config_source = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] debug = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.341944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_config_append = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_dir = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.342808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_file = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_config_append = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_dir = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.343905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_file = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.344980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.345899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] publish_errors = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.346920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] publish_errors = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.347896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] standard_threads = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.348854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] use_journal = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] standard_threads = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] use_json = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] use_stderr = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] use_syslog = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.353897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] use_journal = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.354035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] use_json = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.354187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] use_stderr = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.354265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] use_syslog = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.354398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:36:08.354544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.354900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.355961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.356981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.357941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.358942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.359936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.360939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.361946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.362958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.363932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.364850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.365939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.366947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367658 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.367892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.368979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.369898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.370875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.371944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.372918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.373983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.374883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.external = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.external = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.375863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.password = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] auth.token = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.password = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.376982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] auth.token = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.377923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.378961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.379906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.380892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.381903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.382963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.383983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.384814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.387602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.387712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.387793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.387865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.387927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.388982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.389960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.390991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.391959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.392939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.393933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.394998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.395928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.396943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.397890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.398945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.399999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.400961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.401788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.402006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.402122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.402237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.402353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.403921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.404996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.405110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.405210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.405401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.405769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.405887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.406939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.407894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.408997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.409944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] role.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] role.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] role.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] role.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.410887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.411938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.412895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.413803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.414965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.415998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.416959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.417899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.418859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.419967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.420943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.421887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.connection = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.connection = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.422975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.423922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.424889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.425960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.426885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.427001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.427116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:36:08.427242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:36:08.427360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:36:08.456899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.457128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.457356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.457585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.457813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.458034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.466562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.467077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.494644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.494876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.494969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.495142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.554584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.555367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.607736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.607962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.608305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.608539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.768300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.768517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.768758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.768980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.769199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.769417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.773310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.773537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.773757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.773975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.774191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.774401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.798926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.799637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.800342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.811346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.812324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.832774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.833897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.834079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.834168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.834332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.834543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.834754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:36:08.851105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.851546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:36:08.851630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.851707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.851817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:36:08.851902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:36:08.852111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.852205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.852342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:36:08.852434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.852639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.852746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.852924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.853010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.853486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.853745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.862526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.862804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.863078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.863365 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.863521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.863797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.864067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.864348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.870347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.871954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.873961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.874247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.874534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.874848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.874939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.875107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.875918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.876913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.877294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.877572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.877842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.900046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.901225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.901554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.901840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.903353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.903631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.907196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.907481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.907768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.908602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.908907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.909184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.914300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.914586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.915507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.915794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.918831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.919126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.919419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.919711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.920002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.920182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.920496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.920802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.921087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.921442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.921722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.921987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.922081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.922250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.922332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.922563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.938156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.940873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.940962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.940962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.942327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.944317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.945442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.945743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.947543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.947841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.950683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.953016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.953848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.956119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.957031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.957338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.957631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.957920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.958224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.958612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.959455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.959753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.960038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.960322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.960599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.960910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.974419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.974720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.974978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.975257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.977776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.978060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.978325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.978584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.982511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.984171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.985754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.986035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.986146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.987775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.988715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.989007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.989288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.989376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.989574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.989656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.989861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.992173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:08.992457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.992874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.993168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:08.993457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.001272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.001560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.001847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.002132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.002415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.002695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.003002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.004846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.005203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.005578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.005860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.006141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.006413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.006686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.018907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.021972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.022917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.024905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.025891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.026341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.028377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.028684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.028979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.029570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.031278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.032983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.033281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.033636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.036281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.037790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.040508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.040683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.040987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.041279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.041572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.041987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.045120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.045410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.045692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.045968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.049810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.050104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.050389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.053911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.054199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.054573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.057314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.057605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.057891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.058168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.058442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.058772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.059096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.059554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.059842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.060125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.060401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.060682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.062990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.062990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:36:09.063130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.063872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.064156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.064431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.064720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.064991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.065255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.065519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:36:09.096439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633333ee9c0 pid: 93237 (default app) Aug 30 14:36:09.100059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96fbc4-357a-46a9-9c9d-dd1682edee7f None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:09.100390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96fbc4-357a-46a9-9c9d-dd1682edee7f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:09.100736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96fbc4-357a-46a9-9c9d-dd1682edee7f None None] PATH_INFO: `/v3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:09.101876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633333ee9c0 pid: 93238 (default app) Aug 30 14:36:09.104927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Tue Aug 30 14:36:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:16.722093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.722606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.722689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.726931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:16.732199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:16.732687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:16.732789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:16.803128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: INFO dbcounter [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] Registered counter for database keystone Aug 30 14:36:16.822972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG oslo_db.sqlalchemy.engines [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:36:16.829843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writer thread running {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:36:17.008902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG passlib.handlers.bcrypt [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93237) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:36:17.009297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG passlib.handlers.bcrypt [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93237) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:36:17.067341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:17.068969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:17.196820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:36:17.669574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.738551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: INFO dbcounter [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] Registered counter for database keystone Aug 30 14:36:17.760151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG oslo_db.sqlalchemy.engines [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:36:17.766901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writer thread running {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:36:17.888050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fd5c8-f99b-4318-9e6b-6fd76deb67b5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.892221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.892868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.893146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.893414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.901416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:17.953878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:36:17.954160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a9a58-b9a3-42a2-bca4-e3a002f0553b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:17.963505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:36:17.969461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:17.984274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537e3f8-d374-48aa-89ed-8935adfa0760 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:17.988745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:17.989825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:17.990103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:17.990371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] PATH_INFO: `/v3/projects/8a0fcacff99247a7a086913fb4245dc0` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:17.991919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] RBAC: Authorizing `identity:get_project(project_id=8a0fcacff99247a7a086913fb4245dc0)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:18.044446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:36:18.044814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e775213-9b94-463e-b706-51480925de3e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:18.049277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Tue Aug 30 14:36:17 2022] GET /identity/v3/projects/8a0fcacff99247a7a086913fb4245dc0 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:19.939145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27d71-95f1-4199-b831-601edd7062ba None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.939645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27d71-95f1-4199-b831-601edd7062ba None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.939734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27d71-95f1-4199-b831-601edd7062ba None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.943791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:19.949283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.949712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.949838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.970103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:19.971582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:19.979209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:36:20.267786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb27d71-95f1-4199-b831-601edd7062ba None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.280730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb27d71-95f1-4199-b831-601edd7062ba None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.285187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.285780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.286056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.286323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.294203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.295962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c352fe-bb7e-4509-ab83-6adfe65b12c7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.304625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:36:20.310234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.319483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc806d0-0ed6-4ec4-bcb0-a076b9b040ca None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.324360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.325054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.325326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.325591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.326900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.328781 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded07c-c422-49e0-97d1-aa0cb804ad50 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.330286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:22.291295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba413-0204-4099-8a40-ac3e48b21eaf None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.291828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba413-0204-4099-8a40-ac3e48b21eaf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.291828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba413-0204-4099-8a40-ac3e48b21eaf None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.293192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:22.298341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.298751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.298889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.317564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:22.318738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:22.337684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf775-3bb6-4a64-9a2a-cff3286f9068 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.337964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf775-3bb6-4a64-9a2a-cff3286f9068 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.338238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf775-3bb6-4a64-9a2a-cff3286f9068 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.339821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:22.344856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.345136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.345408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.387767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG passlib.handlers.bcrypt [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93238) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:36:22.388154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG passlib.handlers.bcrypt [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93238) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:36:22.398130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:22.438182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:22.439782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:22.539322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:22.676222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.701109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.794169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52892c-aaa0-4c04-98df-cee0b50a2aa0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.808696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.831892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.832527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.832844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.833120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.845401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:22.853982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:22.854836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:22.855650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:22.861095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:22.913923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f71f45-e189-4483-89e7-a73a9cec2914 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.916183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.943889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:22.951077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.951916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.952191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.952457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.961871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e147b1-aba2-4ee0-bdc3-190bd5f2cc72 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:22.997094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:22.997698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:22.997980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:22.998262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:22.998940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:22.999253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.000695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.012492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:23.017947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.024718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.026238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.117058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202bdff-40da-4975-9a27-d93f5060d741 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.122761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:36:23.128360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.131097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.150931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.151558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.152402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.152683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.153878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.155581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.157214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:23.162611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.177276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.231932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899ca5-7b59-41bd-9a3c-9ca18a61332f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.261843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f88b-3e33-4622-b8bb-c47f36ea51b9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.266022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.266863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.267138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.267403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.286660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.288120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.295736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.296362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.296643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.296945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.298062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.299498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.301064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:23.306758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:36:23.307408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:23.309210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:36:23.310005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:36:23.310005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:36:23.310005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:23.310005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:23.315089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:23.370608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.387867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:23.406445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b4af4-1c66-42c3-adf5-ed126a4163a9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.414401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feeffd-a75e-4957-9c47-e69b2385a701 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:23.440885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.441487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.441771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.442043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.442771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.domain.id=default, user.id=34c5f40ca7234d1bbbf4ac2eff849e1c) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:23.443079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.444522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfd548-8042-471a-98d5-594902e07852 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.447245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:23.447835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:23.448112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:23.448384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:23.449693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:23.449988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:23.451367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57084bd-c64c-47a3-ae08-dde54c7ae28b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:23.451957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/role_assignments?user.id=34c5f40ca7234d1bbbf4ac2eff849e1c&scope.domain.id=default&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:23.470886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:25.638841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458409-ab57-42b6-b4ff-d50637605b54 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.639402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458409-ab57-42b6-b4ff-d50637605b54 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.639402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458409-ab57-42b6-b4ff-d50637605b54 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.640950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:25.650036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd0ea-8ff3-4114-8364-21d07b14a4a3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.650036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd0ea-8ff3-4114-8364-21d07b14a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.650036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd0ea-8ff3-4114-8364-21d07b14a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.666368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374602c-170c-43c3-ae81-dec73f01abd2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.666653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374602c-170c-43c3-ae81-dec73f01abd2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.666936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374602c-170c-43c3-ae81-dec73f01abd2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.668816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 13/23] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:25.674164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b95e-36c1-47ae-b0b1-d62faa623c67 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.674447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b95e-36c1-47ae-b0b1-d62faa623c67 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.674722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819b95e-36c1-47ae-b0b1-d62faa623c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.702019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0bfdd0ea-8ff3-4114-8364-21d07b14a4a3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:25.705221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0bfdd0ea-8ff3-4114-8364-21d07b14a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:25.721009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b819b95e-36c1-47ae-b0b1-d62faa623c67 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:25.722223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b819b95e-36c1-47ae-b0b1-d62faa623c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:25.851919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:25.891016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:26.018164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74a21-0dad-4e2d-af9f-9c7605888cfa None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.018806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74a21-0dad-4e2d-af9f-9c7605888cfa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.019295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74a21-0dad-4e2d-af9f-9c7605888cfa None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.020861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 12/26] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:26.025858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.026146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.026419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.050799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:26.052128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:26.166121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:26.445635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac74a21-0dad-4e2d-af9f-9c7605888cfa None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.479334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.485939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.512903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.609085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283e8d1-7c8e-4d42-ae4b-fb5159824e1c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.614086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac74a21-0dad-4e2d-af9f-9c7605888cfa None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.651460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.653018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.653305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.653583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.658700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.659985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.660473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.661092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.665250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.667030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.675606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:26.682741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:26.683807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:26.684717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4182a039-2a83-41c5-a111-06298df05fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:36:26.685888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:26.686695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:36:26.687532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:36:26.687532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:36:26.687532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:26.687532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 16/28] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:26.688261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6a06-663b-4af4-934a-4c5a677adf58 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.688604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6a06-663b-4af4-934a-4c5a677adf58 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.688884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6a06-663b-4af4-934a-4c5a677adf58 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.690118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 13/29] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:26.691103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.695218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 17/30] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:26.696120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6a06-663b-4af4-934a-4c5a677adf58 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:26.779802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.806340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6186ea-8849-47be-bd67-7f077f17a535 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.815341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:26.832314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6a06-663b-4af4-934a-4c5a677adf58 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:26.844550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.845299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.845690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.845984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.846794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.848516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.872939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:26.873554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.873833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.874106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.874792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:26.875096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:26.876482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2326e-a8ec-458d-8de4-31784a1a1401 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:26.894913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 18/31] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:26.895887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:26.896180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:26.896454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:26.918970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:26.920191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:26.999612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 19/32] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:27.000523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.052121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.066330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 14/33] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 14:36:26 2022] POST /identity/v3/roles => generated 219 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:27.067652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.182544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0475346-bb2c-4ccf-9ca8-d8a47be89c6f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.250206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.251173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.251654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.252122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.253019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:27.253539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.255136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.267358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 20/34] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:27.274462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.288012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278506e7-ba20-4b40-bad4-84ce817c166b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.327169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.328255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.328776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.329252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.330384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.332163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.399855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d03b8-5be2-4202-9022-eefa63cc305c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.410503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.436753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.437376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.437653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.437917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.439074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.440509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf254-8a44-475f-8756-774653dd9944 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.442382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 21/35] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:27 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:27.443373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ee131-19f5-432c-8496-e85b4537f13a None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.443724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ee131-19f5-432c-8496-e85b4537f13a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.443978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ee131-19f5-432c-8496-e85b4537f13a None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.445183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 22/36] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:27.445956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ee131-19f5-432c-8496-e85b4537f13a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.452643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 15/37] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:36:27 2022] POST /identity/v3/projects => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:27.453946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.475668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.568496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b36e-2357-4843-8d7f-7fa213141259 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.582837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ee131-19f5-432c-8496-e85b4537f13a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.608190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.608869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.609154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.609428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.610580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.612272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d0e2f-90a2-4bd9-923c-dd38ccdaa860 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.614097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 16/38] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:27.615246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.615475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.615757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.626556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.627315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.627734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.628187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.629126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.630803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb906123-3ee0-49e1-9a30-696f4873fb66 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.636299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:27.638007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:27.711092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 17/39] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:27.712039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:27.730227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:27.824683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225672f8-2903-4c4a-9fd9-3700ad6dd2b2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:27.844694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 23/40] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 14:36:27 2022] POST /identity/v3/roles => generated 225 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:27.846283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8e10-2791-4f10-b9b2-a4d7948ec859 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.846580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8e10-2791-4f10-b9b2-a4d7948ec859 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.846861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8e10-2791-4f10-b9b2-a4d7948ec859 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.848127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 24/41] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:27.854036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.854345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.854630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.862385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:27.863077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:27.863360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:27.863638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] PATH_INFO: `/v3/domains/default/users/34c5f40ca7234d1bbbf4ac2eff849e1c/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:27.866213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=34c5f40ca7234d1bbbf4ac2eff849e1c, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:27.867705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:27.975253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 18/42] 10.222.0.13 () {58 vars in 1361 bytes} [Tue Aug 30 14:36:27 2022] PUT /identity/v3/domains/default/users/34c5f40ca7234d1bbbf4ac2eff849e1c/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:27.986591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:27.991322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:28.009222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.025044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.080686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 25/43] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:28.122479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.147710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b00fb-d38b-4882-a17d-98dac86fb723 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.189310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.190011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.190365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.190712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.191456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.192956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.275562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 19/44] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 14:36:28 2022] POST /identity/v3/roles => generated 223 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:28.373499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.484474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d13284-b6dd-4e02-99bc-5c9468c4c535 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.518002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.518634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.518918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.519194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.520303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.521923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d15bb-63c1-4c70-b9a6-a42a3cbc4104 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.523483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 26/45] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:28.529424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:28.650646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027084ac-e39a-47bd-9f6d-5e73bc9abb10 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:28.687920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:28.688500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:28.688812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:28.689084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:28.689721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:28.691252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882feaa-ac0e-4c8e-9253-96078d6be158 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:28.696570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:28.774194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 20/46] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:36:28 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:30.029190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3762c7-7e78-48bc-8f12-b0be39d34fd6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.029725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3762c7-7e78-48bc-8f12-b0be39d34fd6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.029810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3762c7-7e78-48bc-8f12-b0be39d34fd6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.031382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 27/47] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:30.037010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.037417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.037572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.056303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:30.057450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:30.128671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 21/48] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:30.408253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3762c7-7e78-48bc-8f12-b0be39d34fd6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.443763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.511387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3762c7-7e78-48bc-8f12-b0be39d34fd6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.546111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.546737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.547019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.547288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.557372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:30.562346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:30.563397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:30.564326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 28/49] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:30.569375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.772354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f06ee5-18b1-4b28-8953-d7292e29623c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.789586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.809234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.809851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.810129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.810401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.811063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:30.811361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.812816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751269ce-1b6d-499a-aa55-3481ca32a9b6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.825098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 22/50] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:30.830777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:30.923658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.930314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427dde-1938-4efb-b784-9a8d46b32ecd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:30.933072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403ce3-981d-4be8-8e0e-0ea523233551 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.933374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403ce3-981d-4be8-8e0e-0ea523233551 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.933733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403ce3-981d-4be8-8e0e-0ea523233551 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.935137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 23/51] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:30.940249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.940528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.940829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.958906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:30.960122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:30.965359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:30.965984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.966267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.966541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.967681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:30.969184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:30.970769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 29/52] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:30.976384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.027284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 24/53] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:31.074598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9e9a-5569-4df7-8d5e-1378c5847d47 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:31.107022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:31.107642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.107927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.108205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.109322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:31.110785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:31.112341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 30/54] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:31.118157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.216676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c0139-e60d-4e62-be21-0e385a42b824 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:31.226885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:31.249818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:31.250410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.250688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.250953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.251665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.domain.id=default, user.id=34c5f40ca7234d1bbbf4ac2eff849e1c) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:31.251965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:31.253423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:31.261859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 25/55] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Aug 30 14:36:31 2022] GET /identity/v3/role_assignments?user.id=34c5f40ca7234d1bbbf4ac2eff849e1c&scope.domain.id=default&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:31.297398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.329553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:31.403482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7be6d-2deb-47e4-8edd-ad87257a426b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:31.439638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:31.440267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.440544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.440860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.441953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:31.443474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450b72-ed7b-4d40-a5bc-844779699a99 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:31.445053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 31/56] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:31.451335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:31.549432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5792-8cf5-4599-9663-f433568dbf6f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:31.582763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:31.583337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.583617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.583890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.584536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:31.586014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866528b-bcf8-49c0-a1d6-ac274e0cd3a4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:31.675392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 26/57] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Aug 30 14:36:31 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:36:33.566266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec52a-4b04-49cc-b6ae-1a0fb4f08bd7 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.566784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec52a-4b04-49cc-b6ae-1a0fb4f08bd7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.566866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec52a-4b04-49cc-b6ae-1a0fb4f08bd7 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.568148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 32/58] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:33.573285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:33.573716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:33.573816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:33.591966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:33.593183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:33.612886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:33.657938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 27/59] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:33.928711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec52a-4b04-49cc-b6ae-1a0fb4f08bd7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.023076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:34.028279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec52a-4b04-49cc-b6ae-1a0fb4f08bd7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.061901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.062514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.062793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.063064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.064165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.065666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e254f72-b28a-4b11-8ce6-8cd3c3836a09 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.067207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 33/60] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:34.072558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:34.168959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58029-aad2-47ba-a20a-c20c00b2c624 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:34.202013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:34.202545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:34.202825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:34.203093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:34.203738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:34.205209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739149a-0709-4605-b0a4-fe4f8e761ae7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:34.302313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 28/61] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:34 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:37.243173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199ac9-1ca3-47e6-ade1-9655628a3769 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.243683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199ac9-1ca3-47e6-ade1-9655628a3769 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.243759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199ac9-1ca3-47e6-ade1-9655628a3769 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.246062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 34/62] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:37.259155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764f5-0cc4-4cc9-b52f-a3c7151c6d84 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.259572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764f5-0cc4-4cc9-b52f-a3c7151c6d84 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.262467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764f5-0cc4-4cc9-b52f-a3c7151c6d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.281669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-434764f5-0cc4-4cc9-b52f-a3c7151c6d84 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:37.283171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-434764f5-0cc4-4cc9-b52f-a3c7151c6d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:37.295871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.372446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 29/63] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:37.542190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09eab-aecc-43a2-a2bb-585c4f5e3da2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.543035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09eab-aecc-43a2-a2bb-585c4f5e3da2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.543563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09eab-aecc-43a2-a2bb-585c4f5e3da2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.545235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 35/64] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:37.550916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265b19-ef7c-45f3-b9b5-9069b71c6ad3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.551202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265b19-ef7c-45f3-b9b5-9069b71c6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.551474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265b19-ef7c-45f3-b9b5-9069b71c6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.570702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-78265b19-ef7c-45f3-b9b5-9069b71c6ad3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:37.571898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-78265b19-ef7c-45f3-b9b5-9069b71c6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:37.658958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 30/65] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:37.706590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09eab-aecc-43a2-a2bb-585c4f5e3da2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:37.718068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d47e4-3c86-41b4-b0a9-149a3ab34e13 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.718348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d47e4-3c86-41b4-b0a9-149a3ab34e13 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.718625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d47e4-3c86-41b4-b0a9-149a3ab34e13 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.720580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 31/66] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:37.725588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa589f-21f1-40b4-ba19-ea1c7f43d357 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.725869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa589f-21f1-40b4-ba19-ea1c7f43d357 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.726148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa589f-21f1-40b4-ba19-ea1c7f43d357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.748210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-79aa589f-21f1-40b4-ba19-ea1c7f43d357 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:37.749592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-79aa589f-21f1-40b4-ba19-ea1c7f43d357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:37.842115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 32/67] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:37.871282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087cd2f-611c-41fe-9b88-d0ea07b26c1f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.873180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087cd2f-611c-41fe-9b88-d0ea07b26c1f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.874492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087cd2f-611c-41fe-9b88-d0ea07b26c1f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.878630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 33/68] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:37.885607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.886118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.886717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.896982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:37.911666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:37.912884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:37.913899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09eab-aecc-43a2-a2bb-585c4f5e3da2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:37.967404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:37.968044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:37.968329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:37.968599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:37.996777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:37.997707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d3f252af-9ee3-479b-badc-776e433d1e8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:38.002704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:38.003537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:38.004306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:38.010002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.035991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029078-a676-4f3b-aa2f-a368f106dff6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.036293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029078-a676-4f3b-aa2f-a368f106dff6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.036545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029078-a676-4f3b-aa2f-a368f106dff6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.038810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 37/71] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:38.043714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.044001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.044275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.063296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:38.064414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:38.086940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.130032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1990899-9653-474b-9e70-e91e92ff739f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.137935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 38/72] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:38.141581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.162462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.168463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.169333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.169748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.170179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.170985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:38.171500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.173041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.186626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 35/73] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.187706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.252341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ec266-46ec-499d-84c6-81cf8c8ae60b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.288295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.289265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.289751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.290266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.294251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903d0e-b35b-4b7c-9b8c-e0398ebbcfb9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.302149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:38.307313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:38.309133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 39/74] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:38.311686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.331682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.333248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.333645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.333921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.334194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.345765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:38.351179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:38.352046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 36/75] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:38.353491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.412191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.427108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8c350-da7a-43a9-af64-72eea9ba0c46 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.457051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8394-1568-4d4e-a1fe-351d4dd2bcf2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.462390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.463015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.463298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.464188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.478115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.479652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.481309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 40/76] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.482079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.499716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.500386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.500682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.500965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.502682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.504179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.506465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 37/77] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.507221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.560742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.584468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77f721-1aa0-494c-9e8b-ee8cce968391 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.609347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45d92-8c89-411f-9324-12eb086122e7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.619450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.620094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.620407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.620869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.621537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:38.621842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.623217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.631234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 41/78] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.631849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.632243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.646795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.647454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.647738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.648011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.648688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:38.649001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.650373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.659504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 38/79] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:38.660158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.738219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f0da-6ed6-49f6-be6f-5c8cd043535e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.758249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d83d-f1f5-45e6-9065-3b9fd48acae3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.773004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.773642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.773911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.774182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.777403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.786002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:38.791034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:38.793070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:38.794386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 42/80] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:38.796419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:38.799429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.800457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.800772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.801049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.853137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:38.867961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.869490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.896446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927474e6-5a3c-40ee-8e99-1a5ab64b4e39 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:38.930005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:38.930612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:38.930898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:38.931176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:38.931832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:38.933433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:38.966237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 39/81] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:38.967073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.025346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 43/82] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:38 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:39.029704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.052958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.074059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5574dd9-6749-4a5f-b086-450e48e7e249 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.096364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.114321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.114884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.115154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.115463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.116864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.119208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.121257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 40/83] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:38 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.121934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.152580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e89317-f0b4-49f7-b17a-0a6671981dd1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.197245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.198402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.198745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.199266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.200538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.202089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.203661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 44/84] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.204427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.244096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab959-f76f-47d0-bbff-e48bedc937dc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.282676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.283288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.283563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.283831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.284502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:39.284945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.286345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.296831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 41/85] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.298690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.317235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.325188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf418f-f728-460d-8fae-28eaadac9587 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.351377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.370391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.370945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.371225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.371499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.373502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.374994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.377493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 45/86] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.377605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.422069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686202a6-10f7-4e34-9156-4a0b8765f70e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.457754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.458366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.458642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.458911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.495324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05eee4-1225-4fe8-beae-8d74b4bb0f53 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.529675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.531415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.534757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.535367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.535639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.535906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.546945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.598932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.613489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.615200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.635765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:39.636616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.724560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 46/88] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:39.725888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.743021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f89ff-2f6f-48e6-89ec-4c0226731b4c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.757328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.779059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.779693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.779976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.780537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.781694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.783136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.789495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 43/89] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.790190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.835173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bec23-de19-4e60-90ae-aa079a387775 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.861093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.872315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.873346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.873838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.874272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.875898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:39.876648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.878520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.884523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 47/90] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.886146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:39.898145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4d71c-bfc0-43e8-8b94-6dd7636c5865 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:39.949507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:39.950204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.950492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.952324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.954614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:39.957564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:39.960277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 44/91] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:39.961131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.061117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b7fb-cf7a-4bed-8632-e206999c64d5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.077635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.113214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.113848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.114129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.114402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.121942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.123876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.128815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 48/92] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.129957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.158831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.182287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f34a-1e30-4f58-aa2d-8e9a68c6b35c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.262380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.263046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.263327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.263594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.288626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e8ff-6147-4eab-8108-73bca7f6cc0d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.329959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.330575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.330847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.331124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.331978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:40.332397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.333985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.340631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 49/93] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.341514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.356845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.358390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.455618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.466705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.499000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a220eb-6932-44a5-a34a-168aa76d55ee None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.562637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 45/94] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:40.574791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.575421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.575706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.575982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.576751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=34c5f40ca7234d1bbbf4ac2eff849e1c) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:40.577065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.578532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.584910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 50/95] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/role_assignments?user.id=34c5f40ca7234d1bbbf4ac2eff849e1c&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.590269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.732971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e01a-768d-49ae-90c2-7ea7203c9fbd None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.779082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.779721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.780003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.780543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] PATH_INFO: `/v3/projects/c416bda0e10b47b784f70a8a2bb42a88` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.781731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] RBAC: Authorizing `identity:get_project(project_id=c416bda0e10b47b784f70a8a2bb42a88)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.783187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf63396-883b-458b-8e7a-303f8debb041 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.784862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 46/96] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/projects/c416bda0e10b47b784f70a8a2bb42a88 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:40.790681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.917541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4258da0-158a-436f-a34c-8146da40a2a5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.956222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.956870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.957159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.957435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.958255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=c416bda0e10b47b784f70a8a2bb42a88, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:40.958572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.960055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b058-4ee5-40ff-a870-cd9fb4bf1257 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.966954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 51/97] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=c416bda0e10b47b784f70a8a2bb42a88&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:41.438688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680ca0-66fc-4d70-b1c5-8495c25b8b0c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.439238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680ca0-66fc-4d70-b1c5-8495c25b8b0c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.439238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680ca0-66fc-4d70-b1c5-8495c25b8b0c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.440569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 47/98] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:41.446186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8a2d-50c7-40d0-bc60-8781fe3eea55 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.446582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8a2d-50c7-40d0-bc60-8781fe3eea55 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.446748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8a2d-50c7-40d0-bc60-8781fe3eea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.473704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-836f8a2d-50c7-40d0-bc60-8781fe3eea55 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:41.474932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-836f8a2d-50c7-40d0-bc60-8781fe3eea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:41.483912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:41.551064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 52/99] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:41.564605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0183-0887-4192-9910-5ba90105ef58 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.564915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0183-0887-4192-9910-5ba90105ef58 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.565189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0183-0887-4192-9910-5ba90105ef58 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.566520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 48/100] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:41.571666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:41.571967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:41.572248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:41.591101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:41.592290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:41.698825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 53/101] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:42.008432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0183-0887-4192-9910-5ba90105ef58 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.031415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.138556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0183-0887-4192-9910-5ba90105ef58 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.196223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.196896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.197180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.197458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.201329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.202798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.204381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 49/102] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:42.209990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.243785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.378889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.425268 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.451610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e2e78-e2cc-4dce-9eee-83428b3ed9be None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.456151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b40fe6-aa80-4d10-93bf-2c86bc03ec76 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.532742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.533861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.534341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.534807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.553399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.554297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.554725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.555142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.555952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.556129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:42.558279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe95f-ab76-49ad-94f5-84712d6b4665 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:42.562734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:42.563571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:42.564344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:42.572715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 50/103] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:42.586161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.677246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 54/104] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/projects => generated 302 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:42.753815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07201085-bf4c-475f-bc21-ff7b1bdc3558 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:42.793237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:42.794254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.794768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.795280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.796211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:42.796734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:42.798341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:42.807760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 51/105] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:42.811685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c72f-60ce-48d4-acc3-2449511270e2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.811979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c72f-60ce-48d4-acc3-2449511270e2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.812259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c72f-60ce-48d4-acc3-2449511270e2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.813659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 55/106] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:42.817190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:42.819229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.819516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.819795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.845363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:42.847137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:42.849007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:42.932979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 56/107] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:43.027583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54be8a-bac0-4cc7-b354-d07c589db6e8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.072494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.073255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.073537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.073809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] PATH_INFO: `/v3/users/3264b1c61a3f4e6398d3a6acf350d31d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.096041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] RBAC: Authorizing `identity:get_user(user_id=3264b1c61a3f4e6398d3a6acf350d31d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.097538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4899f0-b8ec-4392-b5ef-f8f0994cbc31 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.099278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 52/108] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:42 2022] GET /identity/v3/users/3264b1c61a3f4e6398d3a6acf350d31d => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:43.105856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.184201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.202311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e26d-b95e-4969-9835-2b802d3cd7ee None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.202594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e26d-b95e-4969-9835-2b802d3cd7ee None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.204018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e26d-b95e-4969-9835-2b802d3cd7ee None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.205642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 53/109] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:36:43.219308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.219948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.220432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.263170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69258ee5-3657-44b6-a24e-bf2bee0e945e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.266761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:43.267580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:43.333807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.334425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.334705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.334978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.391908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.404095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:43.425996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.499648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.501214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.608492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe03d-6d37-4b07-aed6-06a8d125507f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.617291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.675657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.676298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.676579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.676881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.685974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 57/111] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:43.687385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.707782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:43.712629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:43.717557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:43.718312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 55/112] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:43.722252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.816016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.825191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded1cf-5fed-4a76-9152-ed115f2a18b4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.871666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.872472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.872861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.873197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.874410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.875941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.877686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 58/113] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:43.878436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a3912-c855-4446-8d69-cf92a64b87ad None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.883247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.911430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.921258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:43.921875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.922154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.922430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.923126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:43.923462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:43.924886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b404175-f858-4fae-b0e0-30b1bb6612c8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:43.934713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 56/114] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:43.940136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb26da-47af-4dfe-8d30-36778c2e4a35 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.940379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb26da-47af-4dfe-8d30-36778c2e4a35 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.940677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb26da-47af-4dfe-8d30-36778c2e4a35 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.942032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 57/115] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:43.942587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb26da-47af-4dfe-8d30-36778c2e4a35 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.995623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286e1b-5ff3-4a62-9bc4-be93a8ff3dc8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.033668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.034478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.034766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.035051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.045580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-660b87cb-fd27-46ba-bce8-6ea07056ca6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:44.050554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:44.051588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:44.052606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 59/116] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:44.053411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb26da-47af-4dfe-8d30-36778c2e4a35 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.053492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2884-4966-4fac-94bd-5e37255e14d6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.053492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2884-4966-4fac-94bd-5e37255e14d6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.056015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2884-4966-4fac-94bd-5e37255e14d6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.056015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 60/117] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:44.056015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2884-4966-4fac-94bd-5e37255e14d6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.077702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.094893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.095502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.095884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.096049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.096811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=3264b1c61a3f4e6398d3a6acf350d31d) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:44.097121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.098578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3206-4529-4db3-8beb-09c706c9b548 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.103860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 58/118] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/role_assignments?user.id=3264b1c61a3f4e6398d3a6acf350d31d&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.105087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.105373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.105651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.128287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:44.129609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:44.165326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.189008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2884-4966-4fac-94bd-5e37255e14d6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.216517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 59/119] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:44.217854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.253334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.255627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.256349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.257659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.259394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.262425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76447-d8c7-4345-98ca-ff6115738397 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.267205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 61/120] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.269833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.270517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.272552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.294325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:44.295516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:44.360769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87276-8a50-41ff-a007-226c06ac2758 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.378284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.381552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:44.382346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.444334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.445186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.445470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.445738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.446418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:44.446717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.448726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.472925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 60/122] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.483496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.522457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.561381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd80362-e4cc-4b41-be18-e27e9392e163 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.627215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.628227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.628743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.629235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.630586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.636680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.638647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 63/123] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.645068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.705012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e4d94-2339-480a-90c8-b3742544a03a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.781086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.781718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.781994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.782265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.783529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.786252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.788634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 61/124] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:44.789426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.837649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9179c4c-e419-476a-9956-d1a6b9cbf134 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.854461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.889917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.890631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.890915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.891190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/7f5962170c4a419c833982807cd8a0e4/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.894325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, user_id=7f5962170c4a419c833982807cd8a0e4, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.895808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.926013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2788805-80f9-42f7-98c5-c0c41642b1dc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:44.960996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.961964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.962247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.962519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.971671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 64/125] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:44 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/7f5962170c4a419c833982807cd8a0e4/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:44.973235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.975410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:44.982631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:44.983533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 62/126] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:44.989116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:44.999859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.184200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824066b-20a2-4377-b735-a0f92f2e8e0c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.184378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad15c-7d30-4a39-ae75-dd753d94829f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.186579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.227497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.228233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.228577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.229616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.233828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.234677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.235399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.236111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.237717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.239716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.241050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:45.242060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 65/127] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.243082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:45.251447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:45.252350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 63/128] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:45.257467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.345101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.372637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dd65b-8e97-44aa-909f-67adbd65dafe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.415536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.417094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.417943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.418678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.419790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:45.420694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.422589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.434032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 66/129] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.438706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.477151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8831e-da86-425f-af11-cff54711cbac None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.523634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.525100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.526361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.526964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/7f5962170c4a419c833982807cd8a0e4/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.531500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, user_id=7f5962170c4a419c833982807cd8a0e4, role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.533624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.547978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69370-74f6-441d-8409-7b309c206fb5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.584556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.585217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.585500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.585787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.586488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:45.586872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.588930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bed2f-4884-46b1-997a-e26032532035 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.595480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.603155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 67/130] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.603155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac4fc-19e5-4edd-bb66-c5e796aeea39 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.603155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac4fc-19e5-4edd-bb66-c5e796aeea39 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.603155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac4fc-19e5-4edd-bb66-c5e796aeea39 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.606549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 68/131] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:45.607440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac4fc-19e5-4edd-bb66-c5e796aeea39 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.636177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:45 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/7f5962170c4a419c833982807cd8a0e4/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:45.638298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.694508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.744762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac4fc-19e5-4edd-bb66-c5e796aeea39 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.792730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.793599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.793886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.794165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.798215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.799726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e786011-2b09-4c49-85b0-276a39230ed5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.804645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 69/133] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.805903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.808864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.809421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.842058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257064e0-ba2b-487b-9302-43582e253c48 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:45.843191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:45.844804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:45.883266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:45.883909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.884193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.884468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.886781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:45.888261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:45.894261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 65/134] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:45.894261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:45.943952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.953103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 70/135] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:45.954220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.023629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.038654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85414c-cd8d-4b01-a899-9ef83bf6f493 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.068027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b53a94-49cb-4f04-86a1-262e9cbca064 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.076082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.076736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.077024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.077299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.079105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.080623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.087390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 66/136] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:46.090197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.126172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.128111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.128773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.130224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] PATH_INFO: `/v3/projects/c416bda0e10b47b784f70a8a2bb42a88` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.131769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] RBAC: Authorizing `identity:get_project(project_id=c416bda0e10b47b784f70a8a2bb42a88)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.134198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.144533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 71/137] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:45 2022] GET /identity/v3/projects/c416bda0e10b47b784f70a8a2bb42a88 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:46.146446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.274817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.296981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002121e-3d39-4db4-81f3-19d9dceeccbc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.339794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41376391-2b4c-4719-9ef3-f2be12916ada None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.363608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.364274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.364559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.364865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/34c5f40ca7234d1bbbf4ac2eff849e1c/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.367927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, user_id=34c5f40ca7234d1bbbf4ac2eff849e1c, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.370005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a65b28-dafb-42d1-971e-2e103f5e2a1f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.386275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.387021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.387315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.387651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] PATH_INFO: `/v3/projects/c416bda0e10b47b784f70a8a2bb42a88/users/7f5962170c4a419c833982807cd8a0e4/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.389929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=c416bda0e10b47b784f70a8a2bb42a88, user_id=7f5962170c4a419c833982807cd8a0e4, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.391654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6eed7-fc4e-457c-99fb-ef4e7cf91a60 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.454209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 67/138] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:46 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/34c5f40ca7234d1bbbf4ac2eff849e1c/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:46.455221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13e46-bb8a-4e62-b668-0a3c7af9c018 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.455504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13e46-bb8a-4e62-b668-0a3c7af9c018 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.455775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13e46-bb8a-4e62-b668-0a3c7af9c018 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.457028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 68/139] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.457782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13e46-bb8a-4e62-b668-0a3c7af9c018 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.484010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.499295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 72/140] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:46 2022] PUT /identity/v3/projects/c416bda0e10b47b784f70a8a2bb42a88/users/7f5962170c4a419c833982807cd8a0e4/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:46.500579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.500896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.501167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.525855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.527875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.639386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13e46-bb8a-4e62-b668-0a3c7af9c018 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.652330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 73/141] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:46.700760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.701397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.701677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.701947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.703059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.704551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.707538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 69/142] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:46.712127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.781320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.831995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bc443-2af8-4505-a6f6-039aa7510229 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.872031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.872638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.872941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.873252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.873876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.875400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.008998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 74/143] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:47.069068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.179940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.205244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4458441-930f-4bb7-9e6d-35144aa19059 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.256797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.257460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.257746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.258025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.273907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:47.279885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:47.281051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:47.282392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 70/144] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:47.289128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.419258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b207-ac46-42c4-994a-284632e745d5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.433663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.460547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.461202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.461488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.461764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.462442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:47.462798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.464494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.475429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 75/145] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.482039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.624247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc593-3a36-48ad-8140-fcb133adb215 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.664850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.665483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.665761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.666041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] PATH_INFO: `/v3/users/3264b1c61a3f4e6398d3a6acf350d31d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.667272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] RBAC: Authorizing `identity:get_user(user_id=3264b1c61a3f4e6398d3a6acf350d31d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.668788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599f70-31a4-4bc4-8dc3-f626d6604697 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.670593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 71/146] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/users/3264b1c61a3f4e6398d3a6acf350d31d => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.676689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:47.728818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ac9a-9db2-41b6-bebe-455513ce4b13 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.729146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ac9a-9db2-41b6-bebe-455513ce4b13 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.729377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2ac9a-9db2-41b6-bebe-455513ce4b13 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.730991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 72/147] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:47.736253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.736534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.736841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.756629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:47.757857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:47.768263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.833334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:47.876396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993078-b9bd-4381-b3fe-e28c7e2dcbc3 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.934095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.934658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.934941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.935213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.941404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.942874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.944545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 76/149] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:47 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:47.951000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.088146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c2b50-b924-4087-93ad-e98d3ad1d0b2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.124888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.125551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.125827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.126097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/3264b1c61a3f4e6398d3a6acf350d31d/roles/97440ad2d7364f74821cf0435a99bd27` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.128021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, user_id=3264b1c61a3f4e6398d3a6acf350d31d, role_id=97440ad2d7364f74821cf0435a99bd27)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.129510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.217681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 74/150] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:47 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/users/3264b1c61a3f4e6398d3a6acf350d31d/roles/97440ad2d7364f74821cf0435a99bd27 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:48.273733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.336435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.404326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883b4bc-70cb-406a-b778-dbaba24d12cd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.445271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.445909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.446186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.446455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.457299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-87449db7-43a2-44a9-8733-62994563b3a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:48.462479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:48.464175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:48.464981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:48.470283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.475215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.534259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef56a-6de0-4dbe-be6b-5d5af1e11727 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.534570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef56a-6de0-4dbe-be6b-5d5af1e11727 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.534801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef56a-6de0-4dbe-be6b-5d5af1e11727 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.536454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 78/152] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:48.550670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.551013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.551289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.585492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:48.586693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:48.630668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6a02f-c649-4635-af53-d95d14a9ec80 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.689178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.690274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.691110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.691839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.692726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:48.693233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.694896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.697291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 79/153] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 14:36:48.707056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 75/154] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.712776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.752132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:48.843632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041934a1-16c2-4edf-8630-2f81c6693189 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:48.892541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:48.893205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:48.893481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:48.893753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:48.895047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:48.896573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:48.898456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 80/155] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:48.904205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:48.992552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.030629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba351a9-dfb9-4ce8-aa9c-2f440fb132f9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.072856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.073559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.073838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.074108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.149031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.151058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.175859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.234152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.297528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:49.307209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.386234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.391577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d80c0-9aed-4b9c-aa26-97c0e7607f66 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.455953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be85f-4461-490b-b761-f658b8cc0839 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.484266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.484933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.485209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.485479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.508359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.509011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.509293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.509567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.517498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.518966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.520619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 77/157] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:49.521329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:49.532403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:49.533391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:49.534233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:49.535363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 81/158] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:49.542337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.600775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.715631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3f1c9-17da-46f2-8426-d1cf52526d96 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.729070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b002-fc96-4e0a-a7bc-ad6a1571d9dc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:49.751261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.751867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.752149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.752423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.753123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.753428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.754876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2d33-7a44-490b-80ac-130ac8907d53 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.763615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 82/159] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:49.764874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b368ef-7f4f-405a-ad29-3d16005f8f8e None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.765158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b368ef-7f4f-405a-ad29-3d16005f8f8e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.765437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b368ef-7f4f-405a-ad29-3d16005f8f8e None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.766692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 83/160] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:49.767702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc149da-8a65-434c-9c4e-0913f9277dcf None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.767977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc149da-8a65-434c-9c4e-0913f9277dcf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.768246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc149da-8a65-434c-9c4e-0913f9277dcf None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.769440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 84/161] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:49.774659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae188a-9572-407e-aa25-778ececde79c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.775126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae188a-9572-407e-aa25-778ececde79c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.775440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae188a-9572-407e-aa25-778ececde79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.794825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0eae188a-9572-407e-aa25-778ececde79c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:49.796087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0eae188a-9572-407e-aa25-778ececde79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:49.798895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:49.799611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.799892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.800158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.800929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:49.801236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:49.802705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9a8a9-3324-4900-9ebf-b9b0e8c99fce None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:49.817135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 78/162] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:49.820560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.820986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.825542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.825851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.875787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:49.879945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:49.925771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 85/163] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:49.926706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae188a-9572-407e-aa25-778ececde79c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.014009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 79/164] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:50.077083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae188a-9572-407e-aa25-778ececde79c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.118869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.120405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.120941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.121413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.122882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.124605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.126548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 86/165] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.132915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.163026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.237877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b1324-82be-4e37-aaad-0eeb42d210bc None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.281365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.282343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.282916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.283399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.361450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.363269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.395280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.482736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 80/166] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:50.488386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.539757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.578723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.664648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511dc-b55b-4347-8750-92f3170c4f3b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.734926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.736501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.737007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.737479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.741885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.744957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.747275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 87/167] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:50.748383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.801190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38404-a049-4c8d-a14d-b0a8a5ead39f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.880126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.890439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.891111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.891399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.891664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.913924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.921641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:50.927059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:50.928120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:50.928942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 81/168] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:50.929623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:50.954625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c327-6373-42ad-a148-41ec052bffd0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.018388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.019397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.019880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.020374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.045411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:51.052043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:51.052962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:51.053819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:51.056688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 88/169] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:51.057899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.139644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b37b-e5d5-4268-8a0e-63136628f64f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.231828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.232577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.232793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.233037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.233774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:51.234079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.236166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:51.251013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 82/170] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:50 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:51.252171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.316603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa18c-ce8e-4c3d-8813-ccbbdbae82a1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.365132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.404263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.404930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.405472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.405743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.406442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:51.406749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.408200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:51.424566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 89/171] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:51.429890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.457773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.472645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affac3-ad38-4d26-9cff-03f1505288d6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.557858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.558480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.558756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.559016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.559693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:51.559997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.561426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03554-3267-433b-803a-d65f8b73a9ff None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:51.572067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 83/172] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:51.574563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3713f-9752-488b-9e57-de941bdd9d11 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.574946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3713f-9752-488b-9e57-de941bdd9d11 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.575201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3713f-9752-488b-9e57-de941bdd9d11 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.576465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 84/173] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:51.583019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3713f-9752-488b-9e57-de941bdd9d11 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.612236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b17f-83ec-4b68-8be7-dfd4e6398a9e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.648262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.648914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.655406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.655406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] PATH_INFO: `/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.655406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] RBAC: Authorizing `identity:get_user(user_id=34c5f40ca7234d1bbbf4ac2eff849e1c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.655406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1961-0e16-4d38-8ccf-76cdab045645 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:51.655406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 90/174] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/users/34c5f40ca7234d1bbbf4ac2eff849e1c => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:51.660074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.660379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.660680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.679956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:51.681291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:51.754258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 91/175] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:51.755192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.770842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.865432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3713f-9752-488b-9e57-de941bdd9d11 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.885879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0a2dc-ce36-4e6a-9cda-d8dd7b86d261 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:51.902388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:51.922726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.923345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.923622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.923889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.976359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:51.977121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.977402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.977668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] PATH_INFO: `/v3/users/7f5962170c4a419c833982807cd8a0e4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.979420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5962170c4a419c833982807cd8a0e4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.980894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a88c3-bbb8-4a0d-8b2f-03ecffea9b08 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:51.982471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 85/176] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/users/7f5962170c4a419c833982807cd8a0e4 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:51.983627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ef1-a445-4992-bab5-f839f8b3e3b9 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.983857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ef1-a445-4992-bab5-f839f8b3e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.984127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ef1-a445-4992-bab5-f839f8b3e3b9 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.985479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 86/177] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:51.986352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a1ce-68dd-40f2-b692-6137d42a3a9f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:51.986623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a1ce-68dd-40f2-b692-6137d42a3a9f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:51.986889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a1ce-68dd-40f2-b692-6137d42a3a9f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:51.988313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 87/178] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:51.992705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a1ce-68dd-40f2-b692-6137d42a3a9f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:51.996974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:51.998475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bd562-6041-456a-92aa-0da055be8ae5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.023339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.106932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 92/179] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:52.106932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d265d8-7f36-49ec-be56-77f0025eea87 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.106932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d265d8-7f36-49ec-be56-77f0025eea87 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.106932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d265d8-7f36-49ec-be56-77f0025eea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.122472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-38d265d8-7f36-49ec-be56-77f0025eea87 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.123575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-38d265d8-7f36-49ec-be56-77f0025eea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.126823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a1ce-68dd-40f2-b692-6137d42a3a9f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.163287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.163890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.164169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.164440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.194431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 93/180] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:52.195669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.195958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.196230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.215070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.216256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.225449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.250927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.254094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.256296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.294734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 94/181] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:52.301725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.413341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 88/182] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:52.413921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.487157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7df00-4b32-4570-8946-12baf55948ae None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.523540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.528244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.528897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.529179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.529449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.542709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959af5-d4e7-4871-a86a-747bb3522a85 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.543854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:52.549935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:52.557640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 95/183] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:52.558660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.584168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.584815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.585095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.585368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.586499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.587993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.592702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 89/184] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.592702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.595835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.673710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3775aa-b93a-4bed-afc0-42ca037e30e6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.698093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d76c8-62a5-4457-812f-cf0841c89525 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.707171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.707798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.708077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.708410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] PATH_INFO: `/v3/projects/c416bda0e10b47b784f70a8a2bb42a88` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.709665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c416bda0e10b47b784f70a8a2bb42a88)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.711230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177614-f43b-410c-9564-ce0797b212c1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.712953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 96/185] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/projects/c416bda0e10b47b784f70a8a2bb42a88 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.714183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c1a3-2cdd-49d6-adda-396a11619c41 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.714465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c1a3-2cdd-49d6-adda-396a11619c41 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.714738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698c1a3-2cdd-49d6-adda-396a11619c41 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.715933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 97/186] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:52.716632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698c1a3-2cdd-49d6-adda-396a11619c41 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.738027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.738762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.739048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.739320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.750928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:52.755723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:52.756770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 90/187] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:52.757566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.770853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.816796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.823639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698c1a3-2cdd-49d6-adda-396a11619c41 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.858401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.859004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.859281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.859549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.860212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:52.860507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.861929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.862455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb2299-7151-4167-bd2d-0e7a7d1f80dd None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.870708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 98/188] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.871621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.901678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:52.902267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.902603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.902877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.903629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=34c5f40ca7234d1bbbf4ac2eff849e1c) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:52.903935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:52.905666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:52.911234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 91/189] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/role_assignments?user.id=34c5f40ca7234d1bbbf4ac2eff849e1c&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:52.912004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:52.985521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b258e3-6ea3-4e5a-82eb-8e7a900579be None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:52.996855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.024118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f55e-4b58-431a-a6f0-0964082efdfc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.026739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.027389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.027662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.027933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.029111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.030857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7bd62-1b4e-4ddb-b139-7f8d42d124c9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.036749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 99/190] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.036749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.036749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.036749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.054125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:53.055297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:53.068692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11808e29-7789-4fe9-9730-648272326157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.069320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11808e29-7789-4fe9-9730-648272326157 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.069594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11808e29-7789-4fe9-9730-648272326157 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.069922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11808e29-7789-4fe9-9730-648272326157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.070708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11808e29-7789-4fe9-9730-648272326157 None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=c416bda0e10b47b784f70a8a2bb42a88, user.id=7f5962170c4a419c833982807cd8a0e4) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:53.071013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11808e29-7789-4fe9-9730-648272326157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.072547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11808e29-7789-4fe9-9730-648272326157 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.079516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 92/191] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:52 2022] GET /identity/v3/role_assignments?user.id=7f5962170c4a419c833982807cd8a0e4&scope.project.id=c416bda0e10b47b784f70a8a2bb42a88&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.080405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11808e29-7789-4fe9-9730-648272326157 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.081106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.149906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 100/192] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:53.151657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.224584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11808e29-7789-4fe9-9730-648272326157 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.267646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.268279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.268556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.268977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.269648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:53.269949 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.271318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.277125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.283005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 93/193] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.283765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.290372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d7ce1-f1d9-4d07-94c9-1b205ad11b94 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.333055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.333694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.333971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.334240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.349742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.350927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.352572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 101/194] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.354125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.374283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.417803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc5003-ecf7-4411-bd50-b1f79136c0a0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.455095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.455688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.455962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.456228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.456906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.458350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.472059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099b078-907b-4f61-801d-de7e05180465 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.504896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.505509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.505784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.506052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] PATH_INFO: `/v3/users/3264b1c61a3f4e6398d3a6acf350d31d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.507160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] RBAC: Authorizing `identity:get_user(user_id=3264b1c61a3f4e6398d3a6acf350d31d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.508584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.511096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 102/195] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/users/3264b1c61a3f4e6398d3a6acf350d31d => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:53.511844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.544643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 94/196] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:53 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:53.545384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.605740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.620342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.627574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8b334-4471-44b2-abda-197004934bdb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.669174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.669938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.670343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.670602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.673874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7dab4-05fb-4865-80d2-617f12979158 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.720240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.720993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.721267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.722324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.735434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:53.740788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:53.741802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:53.742824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 95/197] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:53.749354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.755542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.757121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.864589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.881571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b857-2219-4b59-8ad7-4288b0cc274f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.888479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 103/198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:53.889194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.903693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.929372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.930379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.932280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.932944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.999942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc686-6fb5-4a31-8ddc-a6f545a3781c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.010863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.012451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.036606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.037494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.037918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.038331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.039136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:54.039584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.041687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.050584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 104/199] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.055904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.122316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.126953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 96/200] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:54.128101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.147196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.199755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f232-b660-4f3a-9a49-be838871d15b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.238410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa92a2-61ec-4bd3-acbf-35c9bc5f7455 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.246080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.246718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.246999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.247274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.248919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.250750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.252750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 105/201] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.253824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.277510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.278792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.279266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.279734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.281526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.283287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.285158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 97/202] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.289651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.372544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e3aa-b92a-4824-8084-6737466006e1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.390006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.401518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.418828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22212c-1da6-4c17-85c6-971e5ee74135 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.419138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.419774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.420057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.420332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.421509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.423969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.425828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 106/203] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.426404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.471099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.471727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.472286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.472774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.474349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8299a96e1967427da8678f4487f0bd9c) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:54.474689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.476548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.484501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 98/204] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/role_assignments?user.id=8299a96e1967427da8678f4487f0bd9c&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.485398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.556046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273049a-c8c6-4cf3-bbc8-d484c29fb15a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.611711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.613875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.614372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.615549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.624816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841aa6-f02a-466e-a2b8-7c4012fff8cd None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:54.700236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:54.700880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:54.701198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:54.701532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:54.702270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, scope.project.id=44b40a2304c941219f8c355fb9397b9d, user.id=3264b1c61a3f4e6398d3a6acf350d31d) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:54.702584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.704023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.717951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 99/205] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/role_assignments?user.id=3264b1c61a3f4e6398d3a6acf350d31d&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:54.727977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:54.760964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:54.762477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:54.910322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 107/206] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:54.916784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:54.937441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:55.056300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611b4a9-064d-4c00-b2d7-7795c96dcb59 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:55.095032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:55.095694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.095971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.096241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.097530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:55.099107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3c17-fc40-4dfb-9649-8da408db8c4c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:55.101064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 100/207] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:54 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:55.107803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:55.193608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:55.215522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f03b-a9b8-4fc4-a2e7-4d00ae0f9d93 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:55.256893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:55.257830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.258307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.258765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.259903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8299a96e1967427da8678f4487f0bd9c) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:55.260396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:55.262068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4314-bb11-46d4-85e2-ca36521b27b8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:55.268903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 108/208] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:55 2022] GET /identity/v3/role_assignments?user.id=8299a96e1967427da8678f4487f0bd9c&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:55.754935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b9cb-b263-4a10-a1bb-6e547a5c6b6f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.755971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b9cb-b263-4a10-a1bb-6e547a5c6b6f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.756454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b9cb-b263-4a10-a1bb-6e547a5c6b6f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.758033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 101/209] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:55.763661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d92a7-8b56-423f-b8c1-65d08181a5fe None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.764188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d92a7-8b56-423f-b8c1-65d08181a5fe None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.764687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d92a7-8b56-423f-b8c1-65d08181a5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.788766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9b4d92a7-8b56-423f-b8c1-65d08181a5fe None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:55.790319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9b4d92a7-8b56-423f-b8c1-65d08181a5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:55.861819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 109/210] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:55.895950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518104-780a-4861-acbe-5f60e84750e7 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.896260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518104-780a-4861-acbe-5f60e84750e7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.896507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518104-780a-4861-acbe-5f60e84750e7 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.897892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 102/211] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:55.903768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:55.904057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:55.904328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:55.922901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:55.924082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:55.992465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 110/212] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:56.155985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518104-780a-4861-acbe-5f60e84750e7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.239912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.264898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518104-780a-4861-acbe-5f60e84750e7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.288825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.300225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.300722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.301957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.302235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.302503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.314985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:56.321713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:56.323638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:56.324492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 103/213] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:36:56.329105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.428605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410a6b-9680-45e1-b11d-aba2a304bdb4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.456798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e679-ff1d-4972-9662-7ad51c30f6d5 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.473350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.474136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.474534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.474903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.476281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.478888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.480738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 111/214] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:56.486635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.502156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.503166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.503448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.503721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.504698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:56.505044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.506692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.519383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 104/215] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:56.524725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.528305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.582984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.615639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cfe0a-9d4e-48a8-bf09-864f18e68b46 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.635613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474ec2-0bc4-4e73-bd88-4d930f893196 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.651729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.652302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.652584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.652893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.653550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.655261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9955e-4a09-4860-bac6-f5d1a100ff9a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.673118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.673741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.674010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.674272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] PATH_INFO: `/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.687886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] RBAC: Authorizing `identity:get_user(user_id=8d2407bc044a4f0aacd84a23fa4d6b42)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.689365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ada44a-2291-4511-9d7a-54fb38e3583a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:56.690966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 105/216] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:56.695591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ad8b-e04a-4d68-8bfd-779116cbf875 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.695591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ad8b-e04a-4d68-8bfd-779116cbf875 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.695591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ad8b-e04a-4d68-8bfd-779116cbf875 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.695591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 106/217] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:56.697669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ad8b-e04a-4d68-8bfd-779116cbf875 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.757651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.780933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 112/218] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:36:56 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:36:56.782171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.782454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.782728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.804856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:56.809216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:56.830080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ad8b-e04a-4d68-8bfd-779116cbf875 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:56.882979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:56.883774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.884257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.884710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.897563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 113/219] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:56.960067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:56.961474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.020591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.063786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 107/220] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:57.069373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.146311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.193993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c5b3-8339-4efe-b8c5-c8b0d2db4e05 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.208119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.242070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.243269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.243688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.244579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.246152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.248470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.251412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 114/221] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:57.257782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.338176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a8e3-6aa9-49cf-ab49-f72de3ab0131 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.385531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.386290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.386575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.386849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.387766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82576ad0-7e6e-4b63-a8f6-5edcf97876e9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.400990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-ba709306-8617-437f-870d-21d0f98eef50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:57.407867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:57.408986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 108/222] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:57.410763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c2cc-3a68-4292-a9ca-0798dd76f210 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.412214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c2cc-3a68-4292-a9ca-0798dd76f210 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.412214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76c2cc-3a68-4292-a9ca-0798dd76f210 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.413564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 109/223] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:57.417614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76c2cc-3a68-4292-a9ca-0798dd76f210 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.421526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.430562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.431171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.433411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.433411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.433411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8d2407bc044a4f0aacd84a23fa4d6b42) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:57.433831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.434976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883008f-0886-4ef4-911f-30d7f358e87a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.441056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 115/224] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/role_assignments?user.id=8d2407bc044a4f0aacd84a23fa4d6b42&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:57.442246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.448989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.449353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.450562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.489916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:57.491166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:57.562646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76c2cc-3a68-4292-a9ca-0798dd76f210 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.609367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.609980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.610259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.610529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.612192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:57.612500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.613938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.625920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 110/225] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:57.631281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.641954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 116/226] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:57.724687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.747904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da064c-3bb7-4edc-9f8a-8439bdae7139 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.801597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.802894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.803387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.803853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.805671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.807585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.809782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 111/227] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:57.816817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:57.940397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26d637-2401-491a-84e9-374bdd45d036 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.961991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.980758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.981663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.982180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.982624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.985179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.986887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.989128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 117/228] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:57 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:57.994783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.039340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.143287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799986-1075-49da-bc2b-726ddcfa93b7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.157232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de856-478c-4400-b9dc-a98d4023ad9c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.196099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.196762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.197100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.197375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.208439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:36:58.214000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:36:58.214877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:36:58.215678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:36:58.216275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.216360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 118/229] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:36:58.216426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.216426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.216426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8299a96e1967427da8678f4487f0bd9c/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.221592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, user_id=8299a96e1967427da8678f4487f0bd9c, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.222476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.223052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.278025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.323472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 112/230] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:57 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8299a96e1967427da8678f4487f0bd9c/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:36:58.335157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875900d4-4715-4a3c-a958-f986c988b8f0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.374825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.375518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.376030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.376305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.377022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:36:58.377326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.378838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.388154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 119/231] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:36:58.394017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.408392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.526089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e3e2-86cf-4ccf-b9f7-65c9e58c1989 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.573433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.574119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.574383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.574655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.575905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.577381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.579348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 113/232] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.584909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.697574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea51d-2db9-4462-9115-cbb62ac49767 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.708545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.733496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.734132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.734419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.734691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.735852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.737428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739413a8-4231-495f-bdcd-3495f66fcef4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:58.739250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 120/233] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:36:58 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:36:58.745648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:58.837228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:58.866737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1070f7-1c4a-4472-b17c-988b6037eeea None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:58.910840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:58.911559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:58.911842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:58.912114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8299a96e1967427da8678f4487f0bd9c/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:58.914327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, user_id=8299a96e1967427da8678f4487f0bd9c, role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:58.916336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc84b6-5466-48f2-b9e0-265f80d7e379 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:59.071304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 114/234] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:36:58 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8299a96e1967427da8678f4487f0bd9c/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:36:59.351865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec44f8-bd4c-4bbe-a5c0-78fa28c0b124 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.352832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec44f8-bd4c-4bbe-a5c0-78fa28c0b124 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.353856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec44f8-bd4c-4bbe-a5c0-78fa28c0b124 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.355671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 121/235] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:59.362147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848f77-f19a-4325-b59d-752199364031 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.362432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848f77-f19a-4325-b59d-752199364031 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.362707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848f77-f19a-4325-b59d-752199364031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.385809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-81848f77-f19a-4325-b59d-752199364031 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:59.387023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-81848f77-f19a-4325-b59d-752199364031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:59.401927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859932-6d7d-445f-8891-6e9c035431c3 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.402544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859932-6d7d-445f-8891-6e9c035431c3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.403019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859932-6d7d-445f-8891-6e9c035431c3 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.404801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 122/236] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:59.410527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e296eea-d6c3-4480-b59f-5daca7f241ac None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.411073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e296eea-d6c3-4480-b59f-5daca7f241ac None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.411573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e296eea-d6c3-4480-b59f-5daca7f241ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.432945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4e296eea-d6c3-4480-b59f-5daca7f241ac None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:59.434578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4e296eea-d6c3-4480-b59f-5daca7f241ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:59.479963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 115/237] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:59.522487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 123/238] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:36:59.720385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43ab0-b7b4-4fec-bdc0-14908c46ba32 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.720709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43ab0-b7b4-4fec-bdc0-14908c46ba32 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.720899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43ab0-b7b4-4fec-bdc0-14908c46ba32 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.722412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 116/239] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:59.727709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.728293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.728818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.748355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:59.749953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:59.780275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43ab0-b7b4-4fec-bdc0-14908c46ba32 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.834189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 124/240] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:36:59.888066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.925641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:59.945966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43ab0-b7b4-4fec-bdc0-14908c46ba32 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:59.991208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:59.992061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.992340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.992610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.004265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.007236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:00.014296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:00.015173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:00.016002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 117/241] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:00.024404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.079314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e21d-0fdd-4660-9f76-1b7c22c8f6a6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.123317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.124292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.124746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.125163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.126763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.128633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.130836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 125/242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:36:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:00.137019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.190462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb7e7-a2c0-40ea-a315-a0257c1b3a1a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.223556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.235071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.236048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.236589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.237029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.237863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:00.238467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.240032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.260831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 118/243] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:00.260831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.276252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0bb61-b2e2-4f73-9c5c-351be205335c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.293703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.331708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.332786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.333301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.333771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.334612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.336549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.403007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c1a1-743a-4546-a2d3-372f73bdcc05 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.422202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 126/244] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:00 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:00.424291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.458042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.459199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.459918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.461377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.486116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:00.499054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:00.500034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:00.500856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:00.505707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 119/245] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:00.513776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.615552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.638162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88926fd-08a3-4c80-9066-23408f770a90 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.678820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.679903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.680383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.680966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] PATH_INFO: `/v3/users/3208e910740d41b39a0cdd9cc5fa34e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.689990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438be87-db96-4e96-8852-d974af9367c8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.699050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] RBAC: Authorizing `identity:get_user(user_id=3208e910740d41b39a0cdd9cc5fa34e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.701726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.703073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 127/246] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/users/3208e910740d41b39a0cdd9cc5fa34e4 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:00.709774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.727524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.728250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.728625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.729116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.729776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:00.730089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.731470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.741030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.741450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 120/247] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:00.747364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.832654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419b32-6f5c-4b02-a5f7-b94185a0a134 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.870062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.870291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b318-1216-4ca8-860b-8f4601904be9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.870679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.871022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.871298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.886469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.912775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.913405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.913696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.913972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] PATH_INFO: `/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.916748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2407bc044a4f0aacd84a23fa4d6b42)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.918279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630c8c9-04ea-49d8-95c8-f6f032158077 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.920611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 121/248] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:00.924767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2050-d433-4ed4-93db-34ae6a9b0f88 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.924767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2050-d433-4ed4-93db-34ae6a9b0f88 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.924767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2050-d433-4ed4-93db-34ae6a9b0f88 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.924767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 122/249] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:00.929762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2050-d433-4ed4-93db-34ae6a9b0f88 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.964353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.966579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411292e4-12e3-4fc3-b24d-77131770d936 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.997881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:01.060707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2050-d433-4ed4-93db-34ae6a9b0f88 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:01.102529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:01.103244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.103244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.103888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.105073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:01.106576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 128/250] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:01.106691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:01.107847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.108136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.108504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 123/251] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:01.108617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.113130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:01.130215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:01.131666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:01.170729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:01.226176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 129/252] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:01.227176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:01.238700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383b82-b3e4-4345-a915-d0113e95f250 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:01.302593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:01.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.303493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.303762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.305546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:01.308694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:01.313367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 124/253] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:01 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:01.322305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:01.331368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:01.442947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85ca0d-1cdb-4ca8-9898-29626aacb3a4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:01.500897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:01.501923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.502498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.503000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8d2407bc044a4f0aacd84a23fa4d6b42/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.505284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, user_id=8d2407bc044a4f0aacd84a23fa4d6b42, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:01.507108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485422d7-b26d-44f4-81f4-8eb75c8a4ff6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:01.556959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bda3f-4c77-4b2b-8b4a-87e61b9fbc71 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:01.583411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:01.602378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:01.603524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.603806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.604079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.604934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=3208e910740d41b39a0cdd9cc5fa34e4) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:01.605153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:01.606647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:01.612576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 125/254] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:01 2022] GET /identity/v3/role_assignments?user.id=3208e910740d41b39a0cdd9cc5fa34e4&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:01.613475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:01.614826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 130/255] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:01 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/8d2407bc044a4f0aacd84a23fa4d6b42/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:01.704546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bffc-3cc3-49ba-a4cc-08d125500aee None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.704948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bffc-3cc3-49ba-a4cc-08d125500aee None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.705228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bffc-3cc3-49ba-a4cc-08d125500aee None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.708255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 131/256] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:01.713116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.713448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.713666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.733254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ccd50-57f5-4c26-b56c-4ce05ffcf0da None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:01.737822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:01.739036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:01.797607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:01.798257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:01.798535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:01.798805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:01.822670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:01.828238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:01.829222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:01.830028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:01.831119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 126/257] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:01.839145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:01.864375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 132/258] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:01.911491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:01.974054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75abc3-7b8d-4bb3-a27f-933720cdb995 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.011042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.011646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.011919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.012185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.016934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:02.017259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:02.018663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:02.032158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 127/259] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:02.038034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.122857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.210840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4801-4bb9-43c9-a0e3-327d42669c46 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.263787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.264817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.265315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.265784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.269374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:02.271035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:02.273212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 133/260] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:02.278683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.374871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.449594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d39a-89fa-4144-9966-ce11cff31296 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.461042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.546918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5449-9dfd-4263-9b87-11f1aa850d06 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.555588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.557096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.557581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.557868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.560318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.621132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.621771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.622045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.624481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.649394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:02.651946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:02.652911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:02.654100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 134/261] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:02.660028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.733657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:02.735195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:02.820858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187c26-93b7-45d3-858c-08225bfaabde None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:02.858008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:02.858666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.858992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.859428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.860115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:02.860420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:02.861899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:02.871369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 135/262] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:02.877125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.903559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 128/263] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:02.909668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:02.913160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.945905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.065883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351dd39-7e1e-47f3-8fd9-d8c0c0662251 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.123289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02696ec7-67b4-4cc5-ba31-befb92bd290d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.129367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.130007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.130282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.130546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.131694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.133166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.135893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 129/264] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.141447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.194807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.195363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.195645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.195921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] PATH_INFO: `/v3/users/8299a96e1967427da8678f4487f0bd9c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.201405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] RBAC: Authorizing `identity:get_user(user_id=8299a96e1967427da8678f4487f0bd9c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.202905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.204640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 136/265] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:02 2022] GET /identity/v3/users/8299a96e1967427da8678f4487f0bd9c => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.218965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.258652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.301802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd304-d0f7-41cb-99aa-e2f833cb2ff4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.368062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.369421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.369705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.369979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.370768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8299a96e1967427da8678f4487f0bd9c) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:03.371081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.372550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b1ffb-6893-402a-b742-3690c355ac3a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.385823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 130/266] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/role_assignments?user.id=8299a96e1967427da8678f4487f0bd9c&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.444616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413b89f-cf0a-429d-804e-ec9195510352 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.453460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.496178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.497273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.497564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.497843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.577902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.579416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.660843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cfb-2ad8-4602-8317-bcd0c9af502a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.661167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cfb-2ad8-4602-8317-bcd0c9af502a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.661402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cfb-2ad8-4602-8317-bcd0c9af502a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.662996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 131/267] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:03.668628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.668969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.669375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.687510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 137/268] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:03.692990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.699323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:03.700833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.702019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.781663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 132/269] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:03.878544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defe72-f0d6-42e3-b0be-07a66f0ecea0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.924122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.924777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.925058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.925328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.926467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.928026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c23640-718c-4201-a5f9-5ce260a24037 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.930057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 138/270] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:03.936210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.021390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbb853-dd37-4eb6-9d1e-717522e5088c None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.021694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbb853-dd37-4eb6-9d1e-717522e5088c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.021887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbb853-dd37-4eb6-9d1e-717522e5088c None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.023572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 139/271] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:04.029003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.029285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.029563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.031886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.065663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:04.067183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.074749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089da5e3-ed4b-421c-8c4e-6d4f0df1305c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.113080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.113846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.114222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.114582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.115397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8299a96e1967427da8678f4487f0bd9c) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:04.115797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.117350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.124598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 133/272] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/role_assignments?user.id=8299a96e1967427da8678f4487f0bd9c&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:04.138801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.202129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.226853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 140/273] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:04.259696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070330e8-c3ac-4529-a4c9-c02c9f701cef None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.304605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.314149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.315059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.315501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.315932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.328336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-4ea419c5-d611-4879-a482-10b3b4920083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:04.333494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:04.334345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:04.335276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:04.338222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 134/274] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:04.346746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.453821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac344d2-9505-4350-b095-23f2bd66348d None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.454408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac344d2-9505-4350-b095-23f2bd66348d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.454863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac344d2-9505-4350-b095-23f2bd66348d None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.456361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 135/275] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:04.461521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.461796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.462061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.480093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f438-e02e-41a9-9ecc-8ff65658b613 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.487305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:04.489238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.522298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.522906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.523406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.523823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.524834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:04.525380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.527200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.538419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 141/276] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:04.539627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.586226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 136/277] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:04.596694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.606213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.651571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f14e-b2ca-4375-9d4b-3080732cb29d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.690099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.691051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.691492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.691921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.693395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.695110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.698104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 142/278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:04.704310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.730215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480f3b-974e-43a2-9f93-07eb2957e1c3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.749296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.767428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.767903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.768178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.768448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] PATH_INFO: `/v3/users/817d76cd4d614b01b3f2e554133983e5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.784942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] RBAC: Authorizing `identity:get_user(user_id=817d76cd4d614b01b3f2e554133983e5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.786417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6431b5-e1d9-4446-a8ac-a30ff9b16e28 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.789108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 137/279] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/users/817d76cd4d614b01b3f2e554133983e5 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:04.791079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a007-2f35-4476-b584-2d178f3146a9 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.791990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a007-2f35-4476-b584-2d178f3146a9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.792265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a007-2f35-4476-b584-2d178f3146a9 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.793669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 138/280] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:04.798817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a007-2f35-4476-b584-2d178f3146a9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.830702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a76d7-9394-4816-97a7-e2b1f90769db None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.860421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.868829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.869613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.869894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.870180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.870819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.872603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.906156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a007-2f35-4476-b584-2d178f3146a9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.939145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.939732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.940004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.940294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.941035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, user.id=817d76cd4d614b01b3f2e554133983e5, scope.system=all) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:04.941333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.942746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300576-a2ec-4472-9a0c-5859048d9bee None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.947821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 139/281] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/role_assignments?user.id=817d76cd4d614b01b3f2e554133983e5&scope.system=all&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:04.948930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.949206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.949472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.969080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:04.970360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.975527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 143/282] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:04.975527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.012808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.050533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 140/283] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:05.108633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05245de-9ffb-43d1-8911-d8d1d72c3863 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.151291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.152239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.152708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.153149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.166390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:05.171899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:05.172819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:05.173620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 144/284] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:05.180968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.295687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81eda9-d554-4759-aba9-64284f77eed1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.324830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.338686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.339635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.340207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.340630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.341444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:05.341806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.343202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.353538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 141/285] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:05.358549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.375118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.398943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.441197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1544298-c968-47e8-95f4-e3c1eed907dd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.472254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501377f-dee3-4420-963e-a123e5525d46 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.481464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.482115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.482395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.482667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.497346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:05.504532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:05.505517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:05.506300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:05.507682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 145/286] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:05.513150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.516107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.516781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.517062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.517335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] PATH_INFO: `/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.518668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2407bc044a4f0aacd84a23fa4d6b42)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.520123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.521960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 142/287] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/users/8d2407bc044a4f0aacd84a23fa4d6b42 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:05.527433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.637928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.640364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50f7b9-5c69-45cb-85e2-8fca4fd50e24 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.649288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2644ce-aa1b-4da7-ba94-6c81c346f0f3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.649478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.677595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.678344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.681483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.681483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.681672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.681758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.681839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.681839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.681839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:05.681839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.682944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.692284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 146/288] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:05.698199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.791247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.792879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.835408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dfbe5-b42a-402d-a11d-3aeea89d7428 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:05.875522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:05.876509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.877391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.877989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] PATH_INFO: `/v3/users/3208e910740d41b39a0cdd9cc5fa34e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.879323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=3208e910740d41b39a0cdd9cc5fa34e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:05.881357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:05.883380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/users/3208e910740d41b39a0cdd9cc5fa34e4 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:05.890032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.927018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.008174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872e2d-317b-48c0-9db6-20d25ff88cf4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.031996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.037596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 143/290] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:06.044301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.051446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.052411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.052905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.053399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.054766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.056939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.059242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 148/291] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:06.065312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.186889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.190364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81de07-1f62-41e9-b0a5-e8f81a8e99f1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.230546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.231551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.232197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.232721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/3208e910740d41b39a0cdd9cc5fa34e4/roles/97440ad2d7364f74821cf0435a99bd27` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.234813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, user_id=3208e910740d41b39a0cdd9cc5fa34e4, role_id=97440ad2d7364f74821cf0435a99bd27)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.236989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70756d4b-c4e4-483d-b35d-467675f2680e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.246541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92ea2-1d71-4d69-a446-ce9a8e77e4b9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.285661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.286257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.286549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.286869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.288062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.289631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.292122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 144/292] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:06.298062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.345368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 149/293] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:06 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/users/3208e910740d41b39a0cdd9cc5fa34e4/roles/97440ad2d7364f74821cf0435a99bd27 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:06.372088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.411258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bfced-d2a3-4d75-afd7-7ebead3913c2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.450501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.451108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.451387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.451660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.452394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=8d2407bc044a4f0aacd84a23fa4d6b42) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:06.452722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.454188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c083-b110-4289-996f-16a457df6ea3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.461314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 145/294] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/role_assignments?user.id=8d2407bc044a4f0aacd84a23fa4d6b42&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:07.027935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e03b1-4d46-472c-8a28-1c49eb15f4ce None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.028462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e03b1-4d46-472c-8a28-1c49eb15f4ce None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.028462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e03b1-4d46-472c-8a28-1c49eb15f4ce None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.030337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 150/295] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:07.035507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87343a-b05a-4a78-9633-196ec16964d6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.035789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87343a-b05a-4a78-9633-196ec16964d6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.036058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87343a-b05a-4a78-9633-196ec16964d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.055281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ea87343a-b05a-4a78-9633-196ec16964d6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:07.056614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ea87343a-b05a-4a78-9633-196ec16964d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:07.126920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 146/296] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:07.316184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d371-9b83-4076-b551-500100cfc433 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.316370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d371-9b83-4076-b551-500100cfc433 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.316652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d371-9b83-4076-b551-500100cfc433 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.318285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 151/297] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:07.324183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.324644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.324757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.342960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:07.344120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:07.402613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d371-9b83-4076-b551-500100cfc433 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.404433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.415545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 147/298] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:07.513683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d371-9b83-4076-b551-500100cfc433 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.550554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.551240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.551523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.551796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.563407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:07.568971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.569828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:07.570617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 152/299] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:07.576678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.682417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bfbc2-bdb2-4adc-9d6c-15d48e35f4f6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.692363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.780230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.797224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.798134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.798713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.799179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.800493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:07.801432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.802643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.814028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 148/300] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.823765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.879992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1493-3c6c-430c-abb7-1dbab00d0836 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.886786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.918306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.918925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.919202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.919473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.929703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6f309582-e3e4-4424-b917-bd7f4614111b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:07.934956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:07.935828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:07.941878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:07.942482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47357-3fb6-4002-b039-e78cef700e43 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 153/301] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b337-7daf-4376-a422-c8ca3bfad8c3 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b337-7daf-4376-a422-c8ca3bfad8c3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b337-7daf-4376-a422-c8ca3bfad8c3 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 154/302] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:07.942554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b337-7daf-4376-a422-c8ca3bfad8c3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:07.978751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.979367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.979663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.979912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] PATH_INFO: `/v3/users/817d76cd4d614b01b3f2e554133983e5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.981066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] RBAC: Authorizing `identity:get_user(user_id=817d76cd4d614b01b3f2e554133983e5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.982490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79eaae-559c-4d8f-a583-7d2901435af5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.984197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 149/303] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/users/817d76cd4d614b01b3f2e554133983e5 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:07.985212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.985492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.985757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.004391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:08.005770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:08.035225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.055503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b337-7daf-4376-a422-c8ca3bfad8c3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.079364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 150/304] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:08.081515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.107029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.108825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.109315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.110063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.111551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.112222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.114911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.132401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 155/305] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:08.134669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.147075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.224493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fd2e-92be-4f80-8d48-04fdb0c40658 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.257245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973a06-b28a-4031-8dff-808fbb86e300 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.276060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.276728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.277007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.277303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] PATH_INFO: `/v3/system/users/817d76cd4d614b01b3f2e554133983e5/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.278685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=817d76cd4d614b01b3f2e554133983e5, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.280531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.299668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.300598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.301247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.301851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] PATH_INFO: `/v3/users/702dedd458164cad96d81cfdff077e2d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.314901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.317333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] RBAC: Authorizing `identity:get_user(user_id=702dedd458164cad96d81cfdff077e2d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.318845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.324814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 156/306] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/users/702dedd458164cad96d81cfdff077e2d => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:08.326855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.376716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 151/307] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Aug 30 14:37:08 2022] PUT /identity/v3/system/users/817d76cd4d614b01b3f2e554133983e5/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:08.382103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.447935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9587e4-6217-4cd4-9a33-26a836853046 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.503522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.504150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.504564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.504861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.505619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, user.id=702dedd458164cad96d81cfdff077e2d, scope.system=all) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:08.506045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.507465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4bbd-d87e-4e08-8ae3-7bdd877556a3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.514091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 157/308] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/role_assignments?user.id=702dedd458164cad96d81cfdff077e2d&scope.system=all&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:08.515591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c186-f54d-4fc7-9ad4-3f2e7c4ad1af None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.515878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c186-f54d-4fc7-9ad4-3f2e7c4ad1af None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.516148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c186-f54d-4fc7-9ad4-3f2e7c4ad1af None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.517690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 158/309] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:08.524505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.524960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.525389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.527366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b039cd-6545-4629-bd25-61af9aa7c0c3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.549299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:08.550517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:08.552427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.583408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.584894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.585565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.586006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.589487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.591793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.593832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 152/310] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:08.599433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:08.637468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:08.648622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 159/311] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:08.722791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d84bb-7b46-4c26-93f2-9c92e449be08 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:08.759590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:08.760442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:08.760928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:08.761364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] PATH_INFO: `/v3/groups` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:08.762202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:08.763833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:08.843383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 153/312] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Aug 30 14:37:08 2022] POST /identity/v3/groups => generated 229 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:08.925584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.036770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd90397-86b9-4c7c-8455-641b64e75189 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.074129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.074766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.075037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.075305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.085766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:09.090712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:09.091584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:09.092371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 160/313] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:09.097635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.144345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.204540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934504e5-3472-4966-a7af-198a1fbbe1f7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.239113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.239716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.239993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.240261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.240964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:09.241264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.242630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.251944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 154/314] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:09.257172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.315622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.366848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e62fe-bffb-4805-829b-7f3e4aa68e86 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.401852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.402474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.402749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.403017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] PATH_INFO: `/v3/users/3208e910740d41b39a0cdd9cc5fa34e4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.404149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] RBAC: Authorizing `identity:get_user(user_id=3208e910740d41b39a0cdd9cc5fa34e4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.405874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.407752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 161/315] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/users/3208e910740d41b39a0cdd9cc5fa34e4 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:09.413129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.522867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e7d4-fb7c-41d6-b2d6-b190ee8e88e2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.530715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.559770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.560733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.561177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.561600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.634305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.636017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.739459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 155/316] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:09.744856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.859721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec8a5-8297-43d6-a145-f3604c0f6f70 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:09.893384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:09.895629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:09.896251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.896523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.896822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.897945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:09.899439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be38c-6a55-475a-a958-16d1561abba5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:09.901813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 162/317] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:09.907650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.920612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.013882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486d0ea-34e5-418c-8255-d4c581e91519 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.050143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.050737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.051019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.051294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.052059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, scope.project.id=856d4006c7884cc4a576e1fa11ccc650, user.id=3208e910740d41b39a0cdd9cc5fa34e4) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:10.052367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.053899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7faef1-6455-4d19-be4d-fe6af57587a6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.061198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 156/318] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/role_assignments?user.id=3208e910740d41b39a0cdd9cc5fa34e4&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:10.450714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f180-93a1-4e11-93ab-d08f336e1399 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.451679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f180-93a1-4e11-93ab-d08f336e1399 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.452156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f180-93a1-4e11-93ab-d08f336e1399 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.453734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 163/319] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:10.458972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.459742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.460221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.479332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:10.480832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:10.521838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2d6d-20f8-438a-a5ad-6bcbd1ffe3de None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.522138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2d6d-20f8-438a-a5ad-6bcbd1ffe3de None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.522381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2d6d-20f8-438a-a5ad-6bcbd1ffe3de None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.523969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 164/320] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:10.528907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.529192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.529466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.547790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:10.548992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:10.551295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.558044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 157/321] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:10.619086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 165/322] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:10.838510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.890376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:10.941525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f98f-9049-4156-a266-eb93e919a95b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.974843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.975462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.975793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.976065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.986659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:10.990854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb23503-21b5-44ff-9afd-80741a84b3c0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-85e35960-5df8-41e9-b47b-6f18d2a3c3a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:10.991467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:10.992423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:10.993339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 158/323] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:10.993989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7fc7-c5f6-4c7c-ba14-b89f39fd3ec2 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.994103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7fc7-c5f6-4c7c-ba14-b89f39fd3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.994456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7fc7-c5f6-4c7c-ba14-b89f39fd3ec2 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.995676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 159/324] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:11.000241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7fc7-c5f6-4c7c-ba14-b89f39fd3ec2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.017620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.032218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.032862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.033139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.033403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.044358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6e00e402-6193-4247-be3b-958a0eb8a460 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:11.049868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:11.050838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:11.051775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 166/325] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:11.052579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.052882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.053150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.067566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.070233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:11.071468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:11.109531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7fc7-c5f6-4c7c-ba14-b89f39fd3ec2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.137416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 167/326] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:11.138419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.143861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.144453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.144749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.145018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.145671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.145966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.147836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.163633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 160/327] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:11.165603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.239130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406be1-17d5-4751-bc61-4c35ec4f32f1 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.250026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.275787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.276390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.276686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.276968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.277385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f598-1fd0-4797-a6c5-a86dc0ef7f76 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.277637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] RBAC: Adding query filter params (name=reader) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.277941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.279332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.289371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 168/328] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.294876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.302359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.314385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e977f-0020-496d-9862-fa437592a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.315001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e977f-0020-496d-9862-fa437592a564 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.315307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e977f-0020-496d-9862-fa437592a564 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.315638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e977f-0020-496d-9862-fa437592a564 None admin] PATH_INFO: `/v3/users/817d76cd4d614b01b3f2e554133983e5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.316976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e977f-0020-496d-9862-fa437592a564 None admin] RBAC: Authorizing `identity:get_user(user_id=817d76cd4d614b01b3f2e554133983e5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.318527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e977f-0020-496d-9862-fa437592a564 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.325682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 161/329] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/users/817d76cd4d614b01b3f2e554133983e5 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:11.326596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e977f-0020-496d-9862-fa437592a564 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.400807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a8fd7-0180-4d48-ab0e-28e0bdf9acee None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.433593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e977f-0020-496d-9862-fa437592a564 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.435260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.435885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.436166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.436442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] PATH_INFO: `/v3/users/702dedd458164cad96d81cfdff077e2d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.437605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] RBAC: Authorizing `identity:get_user(user_id=702dedd458164cad96d81cfdff077e2d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.439041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.440615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 169/330] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/users/702dedd458164cad96d81cfdff077e2d => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:11.441391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.467384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.467982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.468258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.468529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.469277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] RBAC: Adding query filter params (role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, user.id=817d76cd4d614b01b3f2e554133983e5, scope.system=all) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:11.469587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.471005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.482875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 162/331] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/role_assignments?user.id=817d76cd4d614b01b3f2e554133983e5&scope.system=all&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.483717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.488118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.554925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff550dc1-0580-4ac9-99aa-65760642eb37 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.555142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.594119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.594823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.595108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.595380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.596570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.598077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.599753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 170/332] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:11.606046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:11.620368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e7cf-04ac-4c99-9b23-eefc41343160 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.670274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.670992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.671320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.671598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] PATH_INFO: `/v3/system/users/702dedd458164cad96d81cfdff077e2d/roles/97440ad2d7364f74821cf0435a99bd27` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.673066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=702dedd458164cad96d81cfdff077e2d, role_id=97440ad2d7364f74821cf0435a99bd27)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.674445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4c279-8bbe-4d1a-8fbd-d23132dd4ae6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.718784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fee9-bc01-4d5c-8cd3-d6abcf36136c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:11.728054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:11.750454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 163/333] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Aug 30 14:37:11 2022] PUT /identity/v3/system/users/702dedd458164cad96d81cfdff077e2d/roles/97440ad2d7364f74821cf0435a99bd27 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:11.752227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb951d-f111-4973-902e-532198862268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:11.752864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb951d-f111-4973-902e-532198862268 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:11.753143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb951d-f111-4973-902e-532198862268 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:11.753412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb951d-f111-4973-902e-532198862268 None admin] PATH_INFO: `/v3/groups` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:11.754059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb951d-f111-4973-902e-532198862268 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:11.755550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb951d-f111-4973-902e-532198862268 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:11.859033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 171/334] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Aug 30 14:37:11 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:13.798343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64553-0a88-44e3-8175-7fceeeaed2c0 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.798343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64553-0a88-44e3-8175-7fceeeaed2c0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.798343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64553-0a88-44e3-8175-7fceeeaed2c0 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.886274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 164/335] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:13.886894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243258-dd12-45e1-b50b-9d6714341596 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.886894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243258-dd12-45e1-b50b-9d6714341596 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.886894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243258-dd12-45e1-b50b-9d6714341596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.886894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-75243258-dd12-45e1-b50b-9d6714341596 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:13.886894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-75243258-dd12-45e1-b50b-9d6714341596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:13.936490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 172/336] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:14.305537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fd54-5041-4a4d-b7dc-fb4fc6227397 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.306201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fd54-5041-4a4d-b7dc-fb4fc6227397 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.306705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67fd54-5041-4a4d-b7dc-fb4fc6227397 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.308238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 165/337] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:14.322801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.323079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.323350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.345703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:14.346918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:14.406414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d8c9-fa2b-4f23-8164-a982bff26bcb None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.406750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d8c9-fa2b-4f23-8164-a982bff26bcb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.406967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d8c9-fa2b-4f23-8164-a982bff26bcb None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.408288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 166/338] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:14.415516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.415825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.416073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.442249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:14.443437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:14.448481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 173/339] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:14.543114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.545151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 167/340] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:14.592845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.688112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f44-9bb4-4567-bd2d-f2d41a7ee3ce None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.729208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.729848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.730127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.730396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.741384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f436839e-7eef-44b6-8c51-3f49ca473a48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:14.747084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:14.748036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:14.749093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 174/341] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:14.754996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:14.830429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:14.869336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7b43f-47b0-4956-8f7f-fe710f7491c7 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.869506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7b43f-47b0-4956-8f7f-fe710f7491c7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.869723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7b43f-47b0-4956-8f7f-fe710f7491c7 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.871253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 175/342] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:14.879698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.883046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.883046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.900589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cdeed-ec85-4766-9423-2477a75c02cd None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:14.910130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:14.917461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:14.945537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:14.946744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:14.947191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:14.947628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:14.948302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:14.948600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:14.949990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:14.967519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 168/343] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:14.977028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.052506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 176/344] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:15.057585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.094614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.144695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3027558-8436-416d-bfb7-0d584beb8a4f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.149100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.191673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.192296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.192567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.192853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.211237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:15.218980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c404e-7544-4e19-9740-06c94cd76274 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:15.221037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.222170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:15.222983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:15.228450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 169/345] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.229414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.276046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.276753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.277040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.277357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] PATH_INFO: `/v3/users/702dedd458164cad96d81cfdff077e2d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.279472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=702dedd458164cad96d81cfdff077e2d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.281239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.282882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 177/346] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/users/702dedd458164cad96d81cfdff077e2d => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.283702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.361295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c2d1b-7fb2-4c53-9473-bb4dc73a8fd9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.393113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.401161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e4463-1a14-4423-aea3-f653a9a81dd8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.407143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.407776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.408069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.408361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.422171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:15.427219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.429463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 170/347] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.432092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.445718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.447189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.447469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.447928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.448612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.448990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.450486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.460559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 178/348] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.461555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.463192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.544907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8494-5edb-4cb6-815f-d0a3b2ddbcfc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.578471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4492c-37f3-4dc8-9b37-02fda3e31b86 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.583212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.583212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.583463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.583821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.584552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] RBAC: Adding query filter params (role.id=97440ad2d7364f74821cf0435a99bd27, user.id=702dedd458164cad96d81cfdff077e2d, scope.system=all) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.584903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.586339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.600370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 171/349] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/role_assignments?user.id=702dedd458164cad96d81cfdff077e2d&scope.system=all&role.id=97440ad2d7364f74821cf0435a99bd27 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.601251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.622876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.623823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.624381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.624981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.626132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:15.626669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.628400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.639329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 179/350] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:15.647596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.665711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.711390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.732127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c15e-be54-4876-b2e4-96753d23c7a1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.765928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a5a62-4649-4a71-a16b-f8bb77e781a7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.771689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.772322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.772601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.772900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.819054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:15.820052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:15.820524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:15.821260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:15.838518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:15.847108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:15.848029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:15.848870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:15.851079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 180/351] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:15.852051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:15.853919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:15.855381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:15.946629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:15.968335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90019-8cdc-4a63-91ab-3d6db08769c7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:15.998313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.009042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.009905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.010376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.010792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.043301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 172/352] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:16.044250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.097183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.100172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.176190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a99e3-0f4b-47a8-87b0-688131ab41d8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.176912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.221098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 181/353] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:16.222045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.223357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.224190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.224971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.225464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.226333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:16.226831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.229611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.240982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 173/354] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.242590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.304215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.339755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834374-8361-4809-848e-5c602b6c9531 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.369985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1be8-18b0-41c6-9311-df9ef26f455d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.377742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.378370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.378646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.378913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.380040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.381516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.383910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 182/355] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.384028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.418720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.419639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.419925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.420202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.421354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.423230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8d22-b294-4b5d-b55c-76b593380824 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.424427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 174/356] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.425604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13b3-e982-44a0-acd3-63feae8d9318 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.425881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13b3-e982-44a0-acd3-63feae8d9318 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.426148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a13b3-e982-44a0-acd3-63feae8d9318 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.427344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 175/357] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:16.428343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3424a-4fe5-40a2-8ed2-d3c143476e41 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.428622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3424a-4fe5-40a2-8ed2-d3c143476e41 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.428982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3424a-4fe5-40a2-8ed2-d3c143476e41 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.430253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 176/358] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:16.431157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3424a-4fe5-40a2-8ed2-d3c143476e41 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.433153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.502656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88ffa-4785-44bf-91d9-ce9914b799dd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.543084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.543691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.543973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.544243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.547761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3424a-4fe5-40a2-8ed2-d3c143476e41 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.562169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.589601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.590605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.590881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.592014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.598812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.600636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec06ab-24df-4d4a-b8d6-ad830113e093 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.603281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 177/359] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.604445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.604749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.605024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.625969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.626566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b4c7-950a-4f8f-b986-8b8b4e3255c3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.627073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:16.628620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:16.678153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.711430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 178/360] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:16.712998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.755722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 183/361] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:16.755722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.755722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.755722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.775466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:16.777022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:16.848586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50964de-30c2-4344-91d3-e09522e4a2d8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:16.860409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:16.868570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 184/362] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:16.873848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.891582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:16.892341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:16.892749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:16.893222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:16.894542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:16.896129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:16.898157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 179/363] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:16.899503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:16.961194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.007869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34270c60-1bef-4c50-8550-50a1a7bc5fe7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.018267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619954-cbae-4072-8ccb-5805c99d1ec0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.065789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.065789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.066074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.066355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.067299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=44b40a2304c941219f8c355fb9397b9d) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.067299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.069556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.069656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.069854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.070135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.070480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.072089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.075141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.075951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 180/364] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.076607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.078775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 185/365] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:16 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.079503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.136480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.216564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab5d7-063d-4a62-a799-4dd0987ad2e7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.221613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d87-0886-4e68-b73e-e90305f415e5 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.257398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.265000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.265570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.265841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.266102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.268585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.269235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.269517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.269787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.270518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=856d4006c7884cc4a576e1fa11ccc650) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.270826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.272276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.278253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:17.279075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 181/366] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.280157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:17.283928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:17.284881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:17.285694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 186/367] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:17.286862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.426164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0e08a-7174-4162-a531-ccd19e7bff06 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.437020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.461818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eda0a-49a6-4684-b7db-4bd2ab42dee1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.474431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.475079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.475359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.475615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.477632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.479985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.482116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 182/368] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.482914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.503385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.504081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.504369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.504642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.520396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:17.528063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:17.529168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:17.530401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 187/369] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:17.531085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.598413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.609693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca219-65f3-4535-a56d-94b50f38bf5f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.647152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.647807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.648091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.648363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.649754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.650068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.651465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.653903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a8b3-b2f5-4a56-86e5-f38289969fc5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.660481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 183/370] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.661359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.693859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.694821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.695246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.695769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.697033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=44b40a2304c941219f8c355fb9397b9d) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.697635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.699296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.701392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.707603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 188/371] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.708584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.778713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2bcd-4310-4a68-8b7f-93a89c7f8cb2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.819344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.820227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.820346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.820609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.822093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:17.822491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.824056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:17.831947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c76a-f35d-4b19-af69-06ca30e68efe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:17.833691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 184/372] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:17.841069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:17.851345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:17.878344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:17.879217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:17.879669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:17.880082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:17.969601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:17.972222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.028039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.033392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea1e47-f640-4414-b61a-b480a46d3b30 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.091281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.092206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.093816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.094335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.132450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 189/373] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:18.138875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.160764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.181304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.182995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.288085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.294245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 185/374] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:18.298859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db7f9-4f6e-42f9-b733-a527a3bffa31 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.299877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.380587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.381596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.381871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.382140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] PATH_INFO: `/v3/projects/8a0fcacff99247a7a086913fb4245dc0` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.383397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fcacff99247a7a086913fb4245dc0)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.385310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.387690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 190/375] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/projects/8a0fcacff99247a7a086913fb4245dc0 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.393458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.467573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee1b3-831b-4292-8943-51436e8a390d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.524938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.536125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.541487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.541487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.541487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.541487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.541487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.542964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 186/376] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.550045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.562584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df616-e558-415d-ad06-e9df90ddabe7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.622431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.623068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.623348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.623617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] PATH_INFO: `/v3/groups/14daa5abbad249f3a9669915d3d7a9ad` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.635557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] RBAC: Authorizing `identity:get_group(group_id=14daa5abbad249f3a9669915d3d7a9ad)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.637077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.638745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 191/377] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/groups/14daa5abbad249f3a9669915d3d7a9ad => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.645330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.679914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.745126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31a5e-2623-4763-be81-faa20646a663 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.826564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93770a-b351-4787-9b7d-6084ad2a3b25 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:18.853677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.854319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.854595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.854862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.861419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.862945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.864620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 187/378] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.867298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:18.868745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:18.869202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:18.869643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:18.870801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] RBAC: Adding query filter params (group.id=14daa5abbad249f3a9669915d3d7a9ad, role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=8a0fcacff99247a7a086913fb4245dc0) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:18.871307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:18.871455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:18.873211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a127f-53b4-4361-91c6-5cf95d2964c4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:18.880728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 192/379] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/role_assignments?group.id=14daa5abbad249f3a9669915d3d7a9ad&scope.project.id=8a0fcacff99247a7a086913fb4245dc0&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:18.993999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d23de-4a7a-4e94-8b5d-ad4891638f9d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:19.035750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:19.036377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.036628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.037033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.037842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=856d4006c7884cc4a576e1fa11ccc650) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:19.038148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:19.040277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924edae8-48e0-44c8-9a4e-43e5b2093cd6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:19.042708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.059057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 188/380] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:18 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:19.447656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22dfdb-5070-4137-b252-627a556c29fe None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.448146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22dfdb-5070-4137-b252-627a556c29fe None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.448223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22dfdb-5070-4137-b252-627a556c29fe None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.449838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 193/381] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:19.454913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4fc3-ce90-4118-8509-811c0634c46c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.455209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4fc3-ce90-4118-8509-811c0634c46c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.455486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4fc3-ce90-4118-8509-811c0634c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.485634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ad2a4fc3-ce90-4118-8509-811c0634c46c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:19.486846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ad2a4fc3-ce90-4118-8509-811c0634c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:19.575072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 189/382] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:19.946165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22dfdb-5070-4137-b252-627a556c29fe None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:19.948323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113532-57bb-4bfc-b499-d8c9cdd8a65e None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.948616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113532-57bb-4bfc-b499-d8c9cdd8a65e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.948926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113532-57bb-4bfc-b499-d8c9cdd8a65e None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.951798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 190/383] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:19.957668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:19.957951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:19.958271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:19.968443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:19.980122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:19.981641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:20.098558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 191/384] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:20.114978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22dfdb-5070-4137-b252-627a556c29fe None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.154768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.155439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.155725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.155993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.167218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8303a005-a4b1-4ef6-91cf-af3ef04f0c79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:20.172728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:20.173612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:20.174410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 194/385] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:20.181578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.252650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.304341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c34a-0bf6-49bf-9480-5020a485c60d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.339892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492af983-13ce-422e-8962-7bc2c46260cf None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.340208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492af983-13ce-422e-8962-7bc2c46260cf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.340425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492af983-13ce-422e-8962-7bc2c46260cf None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.342106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 195/386] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:20.348786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.348951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.349210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.358139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.358996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.359408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.359834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.360639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.361102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.362908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.375217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 192/387] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.380375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.381797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:20.383015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:20.491933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 196/388] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:20.493196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.495624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.539240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40281d2-c546-407b-a3f2-b8290a9d70d9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.563183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.575294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.577832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.577832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.577832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.577832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.579329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.581296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 193/389] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.587093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.652644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fcd1f-0dc8-479e-9b4b-5c2682419cf6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.693421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.694283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.694576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.694846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.710377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:20.717641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:20.718639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:20.719505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 197/390] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:20.721468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407c766-292d-4021-bfd1-15e5c7cd00ad None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.724416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.785351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.786338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.788090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.788604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.792482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.794180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.796277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 194/391] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.806395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.818224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.864644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df2b2-3a35-4269-9a5a-f5c2e1cb11d0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.887712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:20.904306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.905218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.905497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.905771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.906436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:20.906740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.908116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:20.917681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 198/392] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:20.918547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:20.935277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bbe7b-3d45-45a5-96ed-7689ff230761 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:20.970326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:20.971145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:20.971516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:20.971881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/groups/0034a27d2a414bbe95246fe8e3257011/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:20.973938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, group_id=0034a27d2a414bbe95246fe8e3257011, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:20.975459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.028607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0041b12-bfd4-4bd6-a63f-7b6d582a8fea None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.053685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.060652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 195/393] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 14:37:20 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/groups/0034a27d2a414bbe95246fe8e3257011/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:37:21.062177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.065411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.066068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.066403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.066654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.081393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:21.087230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:21.088210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:21.089056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:21.094870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 199/394] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:21.095117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.219989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a0ff-58fa-4faa-86b2-56a82c68b1ac None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.227586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295117d1-6160-4ccf-85f4-a8494fc8785d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.238672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.257836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491825a7-7743-4257-98ff-135837041365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.258849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491825a7-7743-4257-98ff-135837041365 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491825a7-7743-4257-98ff-135837041365 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.259407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491825a7-7743-4257-98ff-135837041365 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.260868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491825a7-7743-4257-98ff-135837041365 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.262468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491825a7-7743-4257-98ff-135837041365 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.264263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 196/395] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.269963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491825a7-7743-4257-98ff-135837041365 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.278795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.280043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.280529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.281052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.281947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:21.283012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.285039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.297626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 200/396] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:21.306486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.368596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.404987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491825a7-7743-4257-98ff-135837041365 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.428832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307550-ad09-4d67-9e04-3d7c388d4469 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.443385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.444014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.444291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.444565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.446479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.447972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.449936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 197/397] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.455638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.478209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.478775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.479056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.479330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.485405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.486882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.488804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 201/398] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:21.507879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.517602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.569205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3c250-335e-41ea-89da-c59ce1f85c22 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.606678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.607336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.607714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.607991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/groups/0034a27d2a414bbe95246fe8e3257011/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.610168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, group_id=0034a27d2a414bbe95246fe8e3257011, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.611908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d97c-7177-4ba5-9843-650c5e9020e5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.647816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234031d-6b41-4338-aae2-30d0a37fd845 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.663028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.682201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.683117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.683398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.683672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.684847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.686281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016880-d5cc-4af0-b4c6-3de61b3c974e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.687903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 202/399] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:21 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:21.689064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b3f3-9b3a-46ce-925e-c269bddd4843 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.689344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b3f3-9b3a-46ce-925e-c269bddd4843 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.689621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b3f3-9b3a-46ce-925e-c269bddd4843 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 203/400] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfd50-1059-40d2-9dca-a6a256d80cce None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfd50-1059-40d2-9dca-a6a256d80cce None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfd50-1059-40d2-9dca-a6a256d80cce None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 204/401] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:21.696708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfd50-1059-40d2-9dca-a6a256d80cce None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:21.701160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 198/402] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 14:37:21 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/groups/0034a27d2a414bbe95246fe8e3257011/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:37:21.702657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5bf4-c241-4722-98d7-24029fe501b5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.703140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5bf4-c241-4722-98d7-24029fe501b5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.703652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5bf4-c241-4722-98d7-24029fe501b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.730052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-062e5bf4-c241-4722-98d7-24029fe501b5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:21.732499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-062e5bf4-c241-4722-98d7-24029fe501b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:21.829553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 199/403] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:21.831031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.831652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.831779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.853007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfd50-1059-40d2-9dca-a6a256d80cce None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:21.862164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:21.863628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:21.893721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:21.896480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:21.896480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:21.896480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d/groups/0034a27d2a414bbe95246fe8e3257011/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:21.898312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] RBAC: Authorizing `identity:create_grant(project_id=44b40a2304c941219f8c355fb9397b9d, group_id=0034a27d2a414bbe95246fe8e3257011, role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:21.899984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:21.910437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:21.946846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 200/404] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:21.990355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 205/405] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 14:37:21 2022] PUT /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d/groups/0034a27d2a414bbe95246fe8e3257011/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:22.167764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.287135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32b24b-28ad-40ad-aa3f-05c28b5e1a66 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.310701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.344539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.345207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.345483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.345746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.367156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:22.379661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:22.381257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:22.382692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:22.389733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 201/406] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:22.395371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.409008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.454615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.495415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f38d-3b31-4eb1-b700-7e6af69af919 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.541250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80fb03-db71-46cf-932f-a8268589b3ef None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.559925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.560547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.560888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.561168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.579849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.580446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.580746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.581015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.581675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.581970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.583686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:22.589167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:22.590030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:22.590830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:22.591424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.599839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 202/407] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:22.600294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 206/408] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:22.605779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.607148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.757301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdcf8-603f-4699-a505-762f8ccb318e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.759163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.814620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:22.817816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a2e0-4339-4697-aebd-adabf4a90a4d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:22.854450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.855060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.855341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.855613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.856302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:22.856599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.860690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.861470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:22.862091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:22.862372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:22.862641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] PATH_INFO: `/v3/groups/14daa5abbad249f3a9669915d3d7a9ad` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:22.864444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] RBAC: Authorizing `identity:get_group(group_id=14daa5abbad249f3a9669915d3d7a9ad)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:22.866019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:22.868026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 203/409] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/groups/14daa5abbad249f3a9669915d3d7a9ad => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:22.872354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 207/410] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:22.873798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:22.877759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.033876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440858c9-30e8-4001-930f-f9b2673af62c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.075130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.076258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.076764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.077247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.079694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.081402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.083663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 208/411] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:23.089513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045ea6-9d61-4358-a521-a3efbe1691f9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.091576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.147997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.150168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.150840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.151869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] PATH_INFO: `/v3/projects/8a0fcacff99247a7a086913fb4245dc0` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.152364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.154911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fcacff99247a7a086913fb4245dc0)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.156692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.160374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 204/412] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:22 2022] GET /identity/v3/projects/8a0fcacff99247a7a086913fb4245dc0 => generated 344 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:23.172135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.232693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.289896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8952-1a92-41db-8e07-cd7e06475f80 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.341128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06712ea-6c34-4ed6-b7b8-5692e3131e63 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.355060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.355502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.355783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.356056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.357226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.358772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178707d-367f-4e04-ae48-b02e839998db None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.360899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 209/413] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:23.362049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8b4c-ca5a-4d4f-8ea2-32dfe6052039 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.362336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8b4c-ca5a-4d4f-8ea2-32dfe6052039 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.362608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8b4c-ca5a-4d4f-8ea2-32dfe6052039 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.368437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 210/414] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:23.369401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8b4c-ca5a-4d4f-8ea2-32dfe6052039 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.387741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.388401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.388704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.388982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] PATH_INFO: `/v3/projects/8a0fcacff99247a7a086913fb4245dc0/groups/14daa5abbad249f3a9669915d3d7a9ad/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.391132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a0fcacff99247a7a086913fb4245dc0, group_id=14daa5abbad249f3a9669915d3d7a9ad, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.392567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa5d5-4644-4c12-b5c9-cdf51238a0e1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.477558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 205/415] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 14:37:23 2022] PUT /identity/v3/projects/8a0fcacff99247a7a086913fb4245dc0/groups/14daa5abbad249f3a9669915d3d7a9ad/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:37:23.479316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.479706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.480059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.500534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.509950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8b4c-ca5a-4d4f-8ea2-32dfe6052039 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:23.527814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:23.530046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:23.591977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:23.593314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.593773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.594318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650/groups/0034a27d2a414bbe95246fe8e3257011/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.596797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] RBAC: Authorizing `identity:create_grant(project_id=856d4006c7884cc4a576e1fa11ccc650, group_id=0034a27d2a414bbe95246fe8e3257011, role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:23.598430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa612a-57c1-4ea3-bdd0-1a95b2706b4a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:23.652648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 206/416] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:23.678363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 211/417] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Aug 30 14:37:23 2022] PUT /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650/groups/0034a27d2a414bbe95246fe8e3257011/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:23.946466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:23.950697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fafe-9e25-46d4-ae7e-1e02c06bad51 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.950978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fafe-9e25-46d4-ae7e-1e02c06bad51 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.951246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fafe-9e25-46d4-ae7e-1e02c06bad51 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.953399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 212/418] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:23.958942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:23.959222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:23.959494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:23.980054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.988565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:23.989800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:24.085416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 213/419] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:24.091036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3e41d-7712-4212-94c5-5bb2ae156dd9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.136799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.137439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.137723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.137993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.161760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:24.167124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.167982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:24.168833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 207/420] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.177801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.297121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.306594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1664e-c9fa-403a-b45e-41285876163e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.342384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6066a8-515c-4797-b80d-237051823766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.342987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6066a8-515c-4797-b80d-237051823766 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.343262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6066a8-515c-4797-b80d-237051823766 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.343530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6066a8-515c-4797-b80d-237051823766 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.344207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6066a8-515c-4797-b80d-237051823766 None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.344504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6066a8-515c-4797-b80d-237051823766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.346029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6066a8-515c-4797-b80d-237051823766 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.355462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 214/421] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.361986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.404841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6066a8-515c-4797-b80d-237051823766 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.469632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.500826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c9ca0-3f55-49d1-8045-9ce5a0ac15f8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.514824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6066a8-515c-4797-b80d-237051823766 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.553740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.554258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.554537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.555453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.557236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.558175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.558600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.559812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.572703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-586a918b-22fd-49f1-8056-2102a316e3ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:24.579093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:24.580179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:37:24.581174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:24.583806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 215/422] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:24.585502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46163d0-85e3-4adb-a81e-af0f6d22f55f None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.585786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46163d0-85e3-4adb-a81e-af0f6d22f55f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.586619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46163d0-85e3-4adb-a81e-af0f6d22f55f None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.591577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 216/423] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:24.592519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46163d0-85e3-4adb-a81e-af0f6d22f55f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.612471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.647207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.649796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.711824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46163d0-85e3-4adb-a81e-af0f6d22f55f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:24.754918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:24.755524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.755804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.756076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.756791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] RBAC: Adding query filter params (name=member) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:24.757086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:24.758575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9da0f2-7305-4efd-a287-11a1e4a8f4ff None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:24.759165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.767774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 217/424] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:24.769092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:24.769379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:24.769655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:24.784224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 208/425] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:24.793096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.793213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:24.793213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:24.875007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 218/426] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:24.876255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:24.887130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:24.965765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b4643-2822-457d-baba-a054c6586355 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.032397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.033033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.033308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.033572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.071179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856da030-887a-4343-a2e7-79d0896ecb03 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.132195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.155204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.156932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.161348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.162019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.162299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.162568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.163745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.165676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.167501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 219/427] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.172898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.273121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.286098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 209/428] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:25.291120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.291645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903421b5-daad-4a8c-9fcb-7217cf01e042 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.341498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.342367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.342789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.343228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.345071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.347234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.350286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 220/429] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.351892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.374257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.394230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428bbfd-fbbe-4df2-9073-ce0b173f749b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.435142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.436078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.436253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.436624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.448086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:25.453146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:25.454233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:25.455217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:25.461824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 210/430] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:25.462844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.491749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0d577-33e7-44da-ae73-fde848c8ce9a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.541320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.542190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.542616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.543062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.544350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.546419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.549237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 221/431] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.550476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.564629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.573095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56421-eaf0-435b-ac42-49297b892b97 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.610582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.611321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.611691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.612102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.613065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=44b40a2304c941219f8c355fb9397b9d) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.613827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.615182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.622647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 211/432] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.623563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.627452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.687986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981039f5-873a-444f-92c9-51a5df559f19 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.732098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.732758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.733041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.733319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.734007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:25.734311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.736487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626024f0-fe16-46fd-be6e-dc35b45e8566 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.751614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 222/433] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.752956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723248b-9e25-42a8-af17-b93b18527521 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.753244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723248b-9e25-42a8-af17-b93b18527521 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.753515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723248b-9e25-42a8-af17-b93b18527521 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.755501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 223/434] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:25.761580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723248b-9e25-42a8-af17-b93b18527521 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:25.790832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e804b-c0d6-470f-8b3a-95a64a7f561c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.842864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.843507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.843782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.844056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.845271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:25.846822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e69a1-ccc8-4bd2-85dc-c6e24f2be685 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:25.852688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 212/435] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:25.852688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.852688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.852688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.870434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:25.882085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:25.887041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:25.921350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723248b-9e25-42a8-af17-b93b18527521 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:25.962115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:25.962830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:25.963103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:25.964293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:25.997125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 213/436] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:25.998467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.019269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.079175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.082885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728045e-1f3f-4e51-a27d-bd4beaab5701 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.163742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bda6e1-394b-48eb-b211-2c6f736778ee None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.184437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.223292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.223485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 224/437] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:26.224069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.224793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.224793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.225003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89841f-331c-4e41-ba96-d833fd78a9f2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.225093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89841f-331c-4e41-ba96-d833fd78a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.225370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89841f-331c-4e41-ba96-d833fd78a9f2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.227176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=e5ba61aaa9cc43ccbaa9e9b83874443b, scope.project.id=856d4006c7884cc4a576e1fa11ccc650) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:26.227176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.227473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 225/438] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:26.228642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cc040-8e50-44f9-b508-2fce597e3746 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.231674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89841f-331c-4e41-ba96-d833fd78a9f2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.244686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 214/439] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:25 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=e5ba61aaa9cc43ccbaa9e9b83874443b => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.244686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011f50-148d-4075-882d-9d828e5d962a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.244686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011f50-148d-4075-882d-9d828e5d962a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.244686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011f50-148d-4075-882d-9d828e5d962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.284684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-92011f50-148d-4075-882d-9d828e5d962a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:26.284684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-92011f50-148d-4075-882d-9d828e5d962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:26.383952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.392523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 215/440] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:26.396476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89841f-331c-4e41-ba96-d833fd78a9f2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.402191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92011f50-148d-4075-882d-9d828e5d962a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.440464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.441104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.442034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.442034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] PATH_INFO: `/v3/projects/44b40a2304c941219f8c355fb9397b9d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.443481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=44b40a2304c941219f8c355fb9397b9d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.444987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.447571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 226/441] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/projects/44b40a2304c941219f8c355fb9397b9d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:26.453596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.502649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.533909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92011f50-148d-4075-882d-9d828e5d962a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.569354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60da9-8626-42dc-943d-4988eb34b8b9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.570268 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.570931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.571159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.571425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.582475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:26.588033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:26.589178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:26.590128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 216/442] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:26.594611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.608226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.608885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.609170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.609442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.610566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.612014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.613614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 227/443] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.619849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.666472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.709824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8a90-b600-4cef-b7f6-47376f514b5a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.722626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866dfc9-adc5-4e7c-b482-40b41cf2a131 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.730581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.743010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.743729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.743869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.744141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.744837 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:26.745143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.746524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.754787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 217/444] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.756617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.763126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.763732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.764013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.764283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.765044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=44b40a2304c941219f8c355fb9397b9d) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:26.765351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:26.766777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:26.778278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 228/445] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=44b40a2304c941219f8c355fb9397b9d&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:26.778278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.881922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90ebf4-408f-4d29-873d-1ffb91cbfaac None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.901463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:26.906082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f37a5-e58a-4ec2-a690-44a11a11fc4d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:26.921018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.926750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.926750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.926750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.934705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:26.939497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:26.940531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:26.941379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 218/446] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:26.946982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:26.953721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:26.954363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:26.954638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:26.954905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:26.997513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.031242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.032715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.077938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485cf-6e38-47fa-b2e3-6269856a7306 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.123444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.124044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.124320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.124586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.125280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.125576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.126932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.137869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 219/447] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:27.143304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.154927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 229/448] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:27.160334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.197098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.252972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.269528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1638-8d1d-42d4-a822-2657cba50db5 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.291651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d169d1-5ae0-4396-a566-6876842cb700 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.306903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.307505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.307776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.308044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.327377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.327996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.328279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.328554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] PATH_INFO: `/v3/projects/8a0fcacff99247a7a086913fb4245dc0` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.329710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0fcacff99247a7a086913fb4245dc0)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.331222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.333065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 230/449] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/projects/8a0fcacff99247a7a086913fb4245dc0 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:27.338979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.378615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.380062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.420417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.437975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184cc39-923e-4fc9-8e42-8b7d5dd84009 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.472292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.472931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.473205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.473475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] PATH_INFO: `/v3/groups/14daa5abbad249f3a9669915d3d7a9ad` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.474881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] RBAC: Authorizing `identity:get_group(group_id=14daa5abbad249f3a9669915d3d7a9ad)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.476332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.478226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 220/450] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:27.481446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 231/451] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/groups/14daa5abbad249f3a9669915d3d7a9ad => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:27.483920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.484492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.493578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.583697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34609da-32dc-44e2-a529-ab554b7073ab None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.588113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eec488-811f-410e-a39e-a535a9495341 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.616397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.617573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.617849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.618120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.618835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] RBAC: Adding query filter params (group.id=14daa5abbad249f3a9669915d3d7a9ad, role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=8a0fcacff99247a7a086913fb4245dc0) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.619135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.620556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.621132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.621744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.622020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.622289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] PATH_INFO: `/v3/projects/856d4006c7884cc4a576e1fa11ccc650` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.623384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] RBAC: Authorizing `identity:get_project(project_id=856d4006c7884cc4a576e1fa11ccc650)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.624823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.626242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 232/452] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/role_assignments?group.id=14daa5abbad249f3a9669915d3d7a9ad&scope.project.id=8a0fcacff99247a7a086913fb4245dc0&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:27.626612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 221/453] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/projects/856d4006c7884cc4a576e1fa11ccc650 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:27.631876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.708408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.740304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f59dc-e27a-4c9a-a4d6-bdf7be41f8b2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.777819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.778453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.778735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.779010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] PATH_INFO: `/v3/groups/0034a27d2a414bbe95246fe8e3257011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.780408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] RBAC: Authorizing `identity:get_group(group_id=0034a27d2a414bbe95246fe8e3257011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.781891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a719-4453-4cb9-a82b-1b59c48a44ad None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.783452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 233/454] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/groups/0034a27d2a414bbe95246fe8e3257011 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:27.790206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:27.806490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:27.899161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197287-1ba8-4353-b87c-e5899e77c590 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:27.932020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:27.932602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:27.932902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:27.933168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:27.933872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] RBAC: Adding query filter params (group.id=0034a27d2a414bbe95246fe8e3257011, role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=856d4006c7884cc4a576e1fa11ccc650) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:27.934171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:27.935580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f69a8-fd79-47ee-ab32-b40be5ee29c5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:27.941057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 222/455] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Aug 30 14:37:27 2022] GET /identity/v3/role_assignments?group.id=0034a27d2a414bbe95246fe8e3257011&scope.project.id=856d4006c7884cc4a576e1fa11ccc650&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:30.487580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e59-3bd8-4d0a-a7f8-956baa352d45 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.488104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e59-3bd8-4d0a-a7f8-956baa352d45 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.488104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1e59-3bd8-4d0a-a7f8-956baa352d45 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.489700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 234/456] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:30.497105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254615-9d21-41ff-bb37-9bb0ef93454b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.497991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254615-9d21-41ff-bb37-9bb0ef93454b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.498467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37254615-9d21-41ff-bb37-9bb0ef93454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.522552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-37254615-9d21-41ff-bb37-9bb0ef93454b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:30.524129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-37254615-9d21-41ff-bb37-9bb0ef93454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:30.552364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bbd1-acf3-4e6a-b216-f5e90a8f2fc9 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.553008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bbd1-acf3-4e6a-b216-f5e90a8f2fc9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.553502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97bbd1-acf3-4e6a-b216-f5e90a8f2fc9 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.555628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 235/457] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:30.560955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d5da-2a23-4a4a-a576-7d2d951cd3a3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.561514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d5da-2a23-4a4a-a576-7d2d951cd3a3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.562003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d5da-2a23-4a4a-a576-7d2d951cd3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.590510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9845d5da-2a23-4a4a-a576-7d2d951cd3a3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:30.591719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9845d5da-2a23-4a4a-a576-7d2d951cd3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:30.634414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 223/458] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:30.684803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 236/459] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:30.813882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a675-5070-4841-bce2-7774a87d026a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.814524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a675-5070-4841-bce2-7774a87d026a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.815083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a675-5070-4841-bce2-7774a87d026a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.816969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 224/460] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:30.823153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21fc10-7c70-45d6-a9e7-4f20602fdf7f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:30.823443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21fc10-7c70-45d6-a9e7-4f20602fdf7f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:30.823716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21fc10-7c70-45d6-a9e7-4f20602fdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:30.857709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cb21fc10-7c70-45d6-a9e7-4f20602fdf7f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:30.858925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cb21fc10-7c70-45d6-a9e7-4f20602fdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:30.943236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:30.955137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 237/461] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:30.967500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a675-5070-4841-bce2-7774a87d026a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:30.970467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.115783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a675-5070-4841-bce2-7774a87d026a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.117822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49ee2-e8c4-48e1-a981-e5b8f773cfe3 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.118373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49ee2-e8c4-48e1-a981-e5b8f773cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.118846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf49ee2-e8c4-48e1-a981-e5b8f773cfe3 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.124194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 238/462] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:31.125708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.126201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.126688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.157304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:31.158806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:31.160155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.160804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.161079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.161434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.172820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.174365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:31.192111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.193288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:31.194279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:31.194279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.194279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:31.194279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 225/463] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.194279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.238856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 239/464] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:31.245822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.276424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.324936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1dbcb-de46-4c7a-a42c-417c067adfb6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.371281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.372154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.372569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.372992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.387666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.389487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:31.405783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.406876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:31.407950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:31.407950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.407950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:31.409771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 226/465] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.410820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.421875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097281-7655-4ea4-84e9-ba49b45fd8de None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.450658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.458933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.459547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.459822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.460098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.461446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.461749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.463611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.477188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 240/466] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:31.478476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.533833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a6ec-67ee-4c03-b86f-c0be2787157d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.548919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.585830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.586859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.587388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.588133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.599512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.600446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1719020-63ba-4e69-834c-cc71b693abdf None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.601014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:31.623689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.624741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:31.625728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:31.625728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.625728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:31.625728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 227/467] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.630025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.645344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.646080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.646259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.646477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.647116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:31.647413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.650780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.674431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 241/468] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:31.675953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.736452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:31.764348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2527973-5af1-465b-a0cf-9c4df65fee9f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.806505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.807107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.807476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.807759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.810283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4f76-8632-450d-87c8-b07c947a7f1e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:31.813227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.814701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.858035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:31.858690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:31.858969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:31.859240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:31.871053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:31.872511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:31.895546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:31.896771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:31.897846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:31.897846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:31.897846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:31.897846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 242/469] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:31.897846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.945652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 228/470] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:31 2022] POST /identity/v3/users => generated 246 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:31.946884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:31.965263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.032937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.039663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc8157-579c-4c77-b886-ea82a74290bb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.066610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2c0e4-4283-4588-a574-311ce1ff2252 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.084818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.086295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.086883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.087402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.088401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:32.088728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.090174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.106405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 243/471] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:32.108873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.110474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.111158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.111490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.111767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.112425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.114028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa44a2-e180-4153-abf6-b3cca20b7be4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.200017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 229/472] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:31 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:32.200709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4d75-9015-4126-8e0a-3107ce9bcacf None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.200709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4d75-9015-4126-8e0a-3107ce9bcacf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.200981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4d75-9015-4126-8e0a-3107ce9bcacf None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.202255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 230/473] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:32.202957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4d75-9015-4126-8e0a-3107ce9bcacf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.242685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328b4f-59c5-466d-8949-317781a2d8e9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.290187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.290813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.291089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.291353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.292122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:32.292431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.294958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9a4be-381c-4902-aadf-e0fb57e47fb5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.311497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 244/474] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:32.314012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.316077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.316077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.316077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.342436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:32.344270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:32.359530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4d75-9015-4126-8e0a-3107ce9bcacf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.368084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.405120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.406089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.406551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.407018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.408167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.410942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.455833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 245/475] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:32.457017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.510312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 231/476] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/users => generated 248 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:32.642540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b72dc6-19a4-4461-8155-a2f4f189d364 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:32.700131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:32.700771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.701051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.701320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.701974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:32.703424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:32.842854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.843859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 246/477] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/users => generated 249 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:33.003116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf9dad-ea72-4935-b468-b30302412fe4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.033028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.042460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.050267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.050267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.050267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.050267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.050267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.109195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.sql.core [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:33.109195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:37:33.109195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [parameters: {'id': '3816d3ce79e54e11a7a7cb3d9faab13b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:37:33.109195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:33.128906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:33.129832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application yield resource Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise self.value Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application session.commit() Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:37:33.131137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:37:33.132012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:37:33.133953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result.read() Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:37:33.134816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [parameters: {'id': '3816d3ce79e54e11a7a7cb3d9faab13b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:33.135710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:37:33.141015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:33.143131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 232/478] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/roles => generated 144 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:33.143364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.151042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.252956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab68b-734e-4ff1-8dcd-aebd834136a1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.300114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.300815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.301048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.301319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.317941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-64079707-3abd-4c38-81c2-d3d05d51962b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:33.323625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:33.325831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:33.327836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 247/479] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:33.333858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:33.453964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acf8df-034b-4df3-af01-5cc15ecbb0e6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.489580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.490181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.490451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.490719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.491379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:33.492237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.494107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84941e-f8b9-467f-9353-536131619bd5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.502707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 233/480] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:34.271026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d73e-f12d-4314-8906-62eff0005e7a None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.271721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d73e-f12d-4314-8906-62eff0005e7a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.271721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d73e-f12d-4314-8906-62eff0005e7a None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.273700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 248/481] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:34.279578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56018-f04f-4009-98ed-6ff55645a1e8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.280069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56018-f04f-4009-98ed-6ff55645a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.280222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56018-f04f-4009-98ed-6ff55645a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.299542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-05c56018-f04f-4009-98ed-6ff55645a1e8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:34.300747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-05c56018-f04f-4009-98ed-6ff55645a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.365887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.391567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 234/482] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:34.757001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eac65-5d78-415f-8ec3-92e355ffaee4 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.757895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eac65-5d78-415f-8ec3-92e355ffaee4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.758180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eac65-5d78-415f-8ec3-92e355ffaee4 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.760194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 249/483] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:34.765437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e21f3-531f-4043-8061-9039856cbada None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.765718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e21f3-531f-4043-8061-9039856cbada None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.765990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e21f3-531f-4043-8061-9039856cbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.771704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eac65-5d78-415f-8ec3-92e355ffaee4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.807746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4c6e21f3-531f-4043-8061-9039856cbada None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:34.807746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4c6e21f3-531f-4043-8061-9039856cbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.897329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.924577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 235/484] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:34.924577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32fa5-3728-4db3-ab6d-c6ea7e729b6f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.924577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32fa5-3728-4db3-ab6d-c6ea7e729b6f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.924577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32fa5-3728-4db3-ab6d-c6ea7e729b6f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.924577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 236/485] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:34.937482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.937892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.938611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.969311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:34.970767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.971532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eac65-5d78-415f-8ec3-92e355ffaee4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.038101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.040333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.040615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.040909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.064219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:35.074064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 237/486] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:35.076458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.077355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:35.078189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 250/487] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:35.083413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.152589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.212428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557c366-22e6-475e-9ba9-f860f1361cfb None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.245971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.254892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.255496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.255771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.256038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.256716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.257014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.258964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73e5ee-3a7b-46bf-ab7f-bc7e4dbc7ebf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.269783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 238/488] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.271212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3eb9-58f5-4a38-93ba-936c4c7c86b3 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.271489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3eb9-58f5-4a38-93ba-936c4c7c86b3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.271758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3eb9-58f5-4a38-93ba-936c4c7c86b3 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.273014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 239/489] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:35.275534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3eb9-58f5-4a38-93ba-936c4c7c86b3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.384246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbbfe-723d-49a2-8ab4-20150e21e761 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.409800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3eb9-58f5-4a38-93ba-936c4c7c86b3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.413003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.418240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.427556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.428442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.428963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.430156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.442744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-02f52896-c689-43e5-9344-eb205679a44c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:35.448747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.449623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.450491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:35.451117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.451117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.451117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.451117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.452980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 251/490] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.454441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.454955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.455439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.462845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.464286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.477144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:35.478609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:35.479459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.480351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:35.485798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:35.485798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.485798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:35.485798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 240/491] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.485798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.552025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 252/492] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:35.553291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.588589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8552-6392-4507-ba3e-4cdea0c6fe8c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.623850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.624472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.624779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.625049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.625716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.626016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.627647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.637085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 241/493] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.637832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.659251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.700123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc16e9-2b25-47f7-b493-189cf40621d6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.724294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.749645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.749855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b6da-a3d8-46f0-89d7-b5b190636728 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.750722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.751448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.752783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.767069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:35.775009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.775873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:35.776686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:35.778080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 253/494] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.778790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.791088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.791687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.791964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.792235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.792905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.793207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.794587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.816702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 242/495] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.816702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.904797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6c4c-874e-4994-bbdb-504f4607c2ba None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.906106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.929287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7ca7f-3588-4f4a-87fe-8401e51010ef None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:35.940970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.941736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.942015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.942280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.954823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.956298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.965631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:35.966226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.966506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.966773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.967429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:35.967724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.969117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:35.971911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:35.972805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:35.973679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:35.973679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:35.973679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:35.982697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 254/497] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:35.982843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 243/497] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:35.982943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:35.983019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.012437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.087310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5fab5-20c6-4b95-a5d2-25848b6d02d0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.088763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208235fd-33a8-474d-9cf4-692610cb92a8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.121585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.121776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929426-375d-4457-967a-465c8da0062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.122196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.122306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929426-375d-4457-967a-465c8da0062f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.122476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.122579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929426-375d-4457-967a-465c8da0062f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.122749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.122840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929426-375d-4457-967a-465c8da0062f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.129998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929426-375d-4457-967a-465c8da0062f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.130401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.131474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929426-375d-4457-967a-465c8da0062f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.134035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:36.139278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.144182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 244/498] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.145099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f5929426-375d-4457-967a-465c8da0062f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:36.145805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.146588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 255/499] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.147487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929426-375d-4457-967a-465c8da0062f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.236830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.245094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ae0fd-79c9-4501-84da-a75da7db037c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.248687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929426-375d-4457-967a-465c8da0062f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.279520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.280131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.280409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.280703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.282968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.283564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.283843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.284116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.284795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.285107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.286518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569394c4-90d7-47fb-9aa4-63494bf0c442 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.291603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.293081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.298545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 256/500] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.299696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d3b24-ef8e-4c2c-bea9-33c8743768c1 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.299980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d3b24-ef8e-4c2c-bea9-33c8743768c1 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.300252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d3b24-ef8e-4c2c-bea9-33c8743768c1 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.306109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 257/501] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:36.306880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d3b24-ef8e-4c2c-bea9-33c8743768c1 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:36.308058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.309162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:36.310013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:36.310013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:36.310013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:36.310013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 245/502] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.310227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.362013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.410220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1127da-a373-45c5-9642-7883a575fc09 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.412013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d3b24-ef8e-4c2c-bea9-33c8743768c1 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.444392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.445908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.445908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.445908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.446414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.446724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.447701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.448301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.448391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efc166-5ca9-4905-bf24-6e71754b625c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.448584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.448887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.449555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.449863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.451244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.459300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 258/503] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.459993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.475537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.486197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 246/504] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.487505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.487721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.487995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.505999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:36.507804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.564056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb618-4559-44b9-939c-a9e3fe6d0a4b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.575343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 247/505] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:36.576178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.599931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.600553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.600888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.601677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.615086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.616631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.626853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:36.628277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.629284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 259/506] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.630171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.693785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc4ae-2467-4f7a-bc86-34b6d19e021f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.718562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.732925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.733738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.734151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.734555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.735317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.735776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.737455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.749002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 248/507] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:36.749831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.756396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda976d-a731-4351-83aa-8127cf4af605 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.794467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.795096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.795376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.795650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.812384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.813925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:36.830036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:36.830978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:36.831810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:36.831810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:36.831810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:36.831810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 260/508] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:36.832026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.861904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.865023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a96522-3822-46bf-a764-3fa1044f2601 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.898729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.899363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.899826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.900650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.939971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b30-fdcc-4ebd-8f3c-1fa88a9fcf19 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.968754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.970203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.972324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.984561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.985189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.985469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.985743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.988997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:36.988997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.988997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.023887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 261/509] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.024635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.064979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.068536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 249/510] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:37.069434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.126947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b354720-b510-46b2-a86f-024ff17318a7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.160359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.161012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.161296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.161559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.167359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea260f7-9bab-4618-a489-b6172e04fb48 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.169219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.170671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:37.182777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.183835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 262/511] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.204409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.205023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.205300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.205570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.206206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.206505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.207885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.219043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 250/512] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.219812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.231478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.278058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.289849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a540b2-6c4a-4209-8195-c933a29221fe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.317964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e4005-0331-4458-b1fe-38cbda8c182f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.324552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.325198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.325483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.325760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.336134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.337617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.351585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:37.352101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.353100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:37.353959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:37.353959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.353959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:37.354134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.354134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.354134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.354313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 263/513] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.354313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.422626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.424087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.443514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.452772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75f5e-8ed8-44c5-b66a-4974766ac1bd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.481618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.485834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.486452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.486730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.487001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.499536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.501023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:37.516377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.517597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:37.518809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:37.518809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.518809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:37.518809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 264/514] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.518809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.525000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 251/515] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:37.525834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.619039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7403-77f1-46f1-befa-150987bce2f5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.622710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b98d6-fa6a-4a17-a3d7-479f44ccf0b2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.652970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.653611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.653888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.654413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.655140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.655471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.656944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.657036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.657595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.657868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.658131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.665424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.666833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.673693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 265/516] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.674502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.679127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:37.679862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.681097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 252/517] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.681984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.703104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.777819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c41a4-1d60-4e99-85b1-065f88c2a4e1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.778272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c1f6-e55e-4c00-9096-022478f6a730 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.813499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.813753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.814096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.814347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.814440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.814622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.814722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.814889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.815254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.815521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:37.815608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.815820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.816939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.817207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.828247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 253/518] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.828374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 266/519] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:37.829088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.829474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:37.893192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.912893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.932060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e6870-5d7d-47cf-aa90-b0005233fbde None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.932543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a122-ea03-4533-9fe3-35243dfc6ffe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:37.966410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.966582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:37.967028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.967122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.967308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.967408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.967578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.967664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.978814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:37.980273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:37.994578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:37.995581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:37.996471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:37.996471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:37.996471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:37.996471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 267/520] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:37.996471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.040012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.041490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.095541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd0ec-f5fe-49e4-9d90-997231634655 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.108748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.118084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.129274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.129874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.130157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.130431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.131164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.131480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.133641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.137434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 254/521] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:38.138243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.153301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 268/522] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:38.153301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.238804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be48b-e114-457b-9841-751f8f177df3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.250223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477847e7-8660-4147-b0d7-148233f832ec None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.277012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.277634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.278817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.278817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.285361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.286300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.286814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.287079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.287506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.287890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.289689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.291257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:38.299056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.300005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 255/523] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.300965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.344989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.374642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 269/524] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:38 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:37:38.375504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.406675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.408825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c3497-344d-41d3-b999-72131d5b59a7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.448020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.448837 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.448964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.449198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.449856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.450284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.451598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.471224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 256/525] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:38.471224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.494661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71b90-1c16-4541-b0cd-ff6f1d314c14 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.534044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.534676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.534955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.535229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.547680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.549373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:38.568348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.569513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:38.571079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:38.571079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:38.571079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:38.571079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 270/526] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.571079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.593048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.597374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1b30-7159-4866-ba48-9f6950aaae6f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.638660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.639296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.639537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.639863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.668472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.688266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e76a-d39a-42e4-a949-6d6a85ad5dc5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.714506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.715964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.724970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.725576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.726432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.726768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.727650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.727960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.729441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.751907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 271/527] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:38.751907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.830810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.839856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 257/528] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:38.839856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.862361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11803c-ee5e-4db4-a8ed-5891b9bc9b7a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.909122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.909746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.910041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.910278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.918040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.919549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.922387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:38.933096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:38.940275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 272/529] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:38.943823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.955332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203a222-c5ea-4802-9642-74cabb9dc552 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.989791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.990387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.990663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.990932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.991624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:38.992100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.993508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.005585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 258/530] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.006493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.059769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062abfb8-9645-4b83-ab67-5021aaa9aa7e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.067649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.097270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.097874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.098155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.098428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.099189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.099499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.100991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.113138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36e19-f3f7-4968-8372-bfc9fe3570e6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.117068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 273/531] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.118060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.153693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.154423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.154702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.154973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.167744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.169342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:39.186489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:39.187450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:39.188306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:39.188306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:39.188306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:39.192381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 259/532] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:39.193392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.216614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.271570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31141-920b-498a-a791-9349a640e784 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.310310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.311303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.311926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.312450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.313422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.313830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.315554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.319453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e2da4-14b5-4215-9127-9a0b53d622c4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.334678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 274/533] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.334678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.339213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.361266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.361893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.362221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.362492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.370735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.372223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:39.385343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:39.386244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:39.387110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 260/534] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:39.388025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.446695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb255c-19ae-4df9-815f-fee0595da566 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.472188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.483609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.487957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.498978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3725f6-1d9c-4eef-b71b-74a06a724e95 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.501634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 275/535] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.503166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.539050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.539712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.539999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.540270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.541029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f8125d6e3bd74258be79e477260a977b) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.541338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.542826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.552695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 261/536] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/role_assignments?user.id=f8125d6e3bd74258be79e477260a977b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.552695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.595749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.665832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce693d0-e3d1-4c11-9f01-4158c9796a4a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.672764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bb23-f82f-4ef9-a550-b06bb591a54d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.706536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.707082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.707361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.707633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.720791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.720791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:39.738602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:39.739703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:39.740773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:39.747702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.748552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.748997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.749445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.750325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.750776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.753444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 262/537] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:39.753902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.758452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.783570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 276/538] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:39.790292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.860961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.922943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d493d-8eb0-4711-a753-acb1ee035bcf None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.945958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.962866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58e3b-477a-4c6f-9183-e36e0d395c02 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:39.963045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:39.963273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.963649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.964204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.965883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=136f5fbf04ab4000b0c80f1955f6515b) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:39.966312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:39.967885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:39.975532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 277/539] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/role_assignments?user.id=136f5fbf04ab4000b0c80f1955f6515b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:40.036976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.037950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.038948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.039363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.040220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:40.040693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.042387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78cc3-1991-4d93-99f2-6a041e0a0420 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.072492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 263/540] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:40.078845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:40.195712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb69e4-b17a-43e7-91db-9b6a11420169 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.205389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.233210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.233743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.234022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.234294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.235033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=01a1375198434203bce21325c7b82c66) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:40.235342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.236813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63255eb-3be9-4f8d-bac4-3f126d7eecfd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.243554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 278/541] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:40 2022] GET /identity/v3/role_assignments?user.id=01a1375198434203bce21325c7b82c66&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:40.531406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9aef-bf36-4008-9401-eecf4a8a5bfa None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.531914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9aef-bf36-4008-9401-eecf4a8a5bfa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.532031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9aef-bf36-4008-9401-eecf4a8a5bfa None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.533584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 264/542] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:40.539062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.539900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.540373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.566035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:40.567584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:40.648612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 279/543] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:41.054316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9aef-bf36-4008-9401-eecf4a8a5bfa None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.182484 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9aef-bf36-4008-9401-eecf4a8a5bfa None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.235645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.236265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.236540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.236832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.253442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:41.258283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:41.259136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:41.259960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 265/544] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:41.266742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.410091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f3f5-88b5-4437-b794-50f1889a9de0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.431359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.446493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.447108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.447392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.447664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.448343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.448647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.450055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5991ab-665f-45b1-b472-ec9b07040094 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.458552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 280/545] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.464388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.512468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.514628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a999d-9040-4a27-906b-10ef2ee35ec2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.514918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a999d-9040-4a27-906b-10ef2ee35ec2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.515192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a999d-9040-4a27-906b-10ef2ee35ec2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.516645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 281/546] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:41.523384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.527976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.527976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.549004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:41.550213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:41.610001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68a16-7641-43ab-be91-84c54e9c4fec None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.681353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 282/547] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:41.685686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.686393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.686736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.687065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.702580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.704059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:41.726172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:41.727161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:41.727979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:41.727979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:41.727979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:41.727979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 266/548] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:41.735010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.839851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.846921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b1e6-9e7d-4a0e-9870-fe7ac5fbbd49 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.882936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.883550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.884078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.884953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.885615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:41.885918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.887387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.899972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 283/549] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:41.905330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.989209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.032709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef694-23ae-4c53-9ab9-72a760c3ea37 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.055234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.097718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.098344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.098619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.098881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] PATH_INFO: `/v3/users/swift` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.109541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.110996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-35a2803b-2aef-4901-b348-72e520ea275f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:42.127573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.128545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:42.129516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:42.132501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 267/550] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:42.134008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c37d-911d-48cb-9cec-960a3b1e6a57 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.134502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c37d-911d-48cb-9cec-960a3b1e6a57 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.134971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c37d-911d-48cb-9cec-960a3b1e6a57 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.136618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 268/551] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:42.142080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.142576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.143055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.161875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.164055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.211177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca8ba-a841-44f4-90ec-f11ded7c8a01 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.253081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 269/552] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:42.253081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.265569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.266595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.267081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.267569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.281540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:42.287661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.289160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.290010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:42.293107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 284/553] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:42.304724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.319695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.367547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.420473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a5fc4-04b5-4ab0-ba32-29e6bb196c4a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.422054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913ed3-f763-43c2-8b06-d5d36048fb82 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.465648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.466245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.466517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.466781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.467505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:42.467804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.469258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.472082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.472948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.473449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.473974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.474866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:42.475391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.477429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c7075-102a-4a7d-8354-a42f4d1288f7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.488521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 285/555] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:42.490161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f1a9-2fc1-4608-8d20-80d34a0042be None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.490650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f1a9-2fc1-4608-8d20-80d34a0042be None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.491682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f1a9-2fc1-4608-8d20-80d34a0042be None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.493957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 270/555] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:42.494588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.499333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 286/556] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:42.500541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f1a9-2fc1-4608-8d20-80d34a0042be None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.590389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.601487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a081c-4b5f-4817-b44f-d7e293919470 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.613550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f1a9-2fc1-4608-8d20-80d34a0042be None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.618063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.634923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.635512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.635809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.636076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.646400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.647028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.647835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.648143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.659015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.660462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c2eacc09-9ec2-42ab-8ab6-667e68f04458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:42.674488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.675531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:42.676397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:42.676397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:42.676397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:42.676397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 287/557] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:42.676815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267bc7-dc39-4568-a454-b2431a8cf6a4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.676977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267bc7-dc39-4568-a454-b2431a8cf6a4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.677267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267bc7-dc39-4568-a454-b2431a8cf6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.695666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6a267bc7-dc39-4568-a454-b2431a8cf6a4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.696912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6a267bc7-dc39-4568-a454-b2431a8cf6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.707672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.709176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:42.762822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 288/558] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:42.764057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78ad0-eac1-4276-894f-235c0484a558 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.764346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78ad0-eac1-4276-894f-235c0484a558 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.764621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78ad0-eac1-4276-894f-235c0484a558 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.766011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 289/559] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:42.766554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78ad0-eac1-4276-894f-235c0484a558 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.824097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 271/560] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:42.825002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:42.839421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.845929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.881600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78ad0-eac1-4276-894f-235c0484a558 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.919458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.920164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.920447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.920805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.931855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-edb17a69-2d44-4d82-953e-ad1da1272fe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:42.936714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:42.937627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:42.938449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 290/561] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:42.939172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.939241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.940147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.947252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e2c59-fd94-4d03-8de9-5ffb0c295da4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:42.957876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.959068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.989124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:42.990113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.990621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.991805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.992669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:42.992974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:42.994587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.006598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 272/562] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.007445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.039188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 291/563] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:43.040015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.093075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.094359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.118955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edaf2a-b2f1-4192-bd7c-ab446d18bcb8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.145120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07f6e-d5bc-4854-9c8b-6808c498bff3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.154305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.155108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.155561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.155993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.169088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.170660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:43.185517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.186654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:43.188022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:43.188022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.188022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:43.188022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 273/564] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.188022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.188596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.189218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.189492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.189786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.190424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.190721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.192091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.200484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 292/565] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.201302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.304216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f520-fb48-408d-b72c-72a7c23d608c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.318217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9360-3707-4a78-821d-9fa3586e3528 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.329356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.330917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.338870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.339489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.339843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.340030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.347226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.348688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.352320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.353063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.353333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.353598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:43.359552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.360700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 274/566] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.361702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.367940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:43.380708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.381694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 293/567] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.383267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.464959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314c2dc-83a1-4955-9a01-8a698aa69163 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.474868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7eb13-2d9f-415a-b624-f0face14b3b5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.498375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.498964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.499259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.499508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.500169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.500467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.501875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.508759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.509371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.509650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.509920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.514343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 275/568] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.515125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.520886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.522915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:43.537645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.539237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:43.540853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:43.540853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:43.540853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:43.540853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 294/569] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.540853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.570845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.572707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.622603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e5a10-4f6f-4781-8988-46381f9d7b7e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.649382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e8f64-1cc2-4012-ac6f-c0f78c4e216f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.656814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.657437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.657714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.657993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.668408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:43.673618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.674585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 276/570] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.675434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.686772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.690272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.690272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.690272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.690272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.690272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.690631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.708775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 295/571] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.713812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.773809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146b51-6488-4745-89d2-6056c87b82c9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.782704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.793826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.809399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.810135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.810423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.810973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.811553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.812092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.813845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a165e6-43b2-468e-95b0-0b4e9b82503c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.823976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.823976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 277/572] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.823976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.852126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.852778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.853054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.853325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.859888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.861392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:43.874371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:43.875412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:43.876316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 296/573] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:43.876832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.926705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa771ba2-638d-4d8c-90bc-ce181f87d73c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.959437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.960533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.960848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.961117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.961747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:43.962046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.963408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.975180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 278/574] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:43.976292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.977043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e928-8498-415b-966d-b1d23935f4c8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.005657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.011850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.012438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.012744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.013015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.013669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.014815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.015516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.023883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 297/575] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.024704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.027200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.074071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdebd9b-5aa1-446e-9eff-596ed6b47c47 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.107591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.108201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.108477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.108772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.118736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.120167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.125100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8ddf-7e0b-470f-b6ee-c93600c42713 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:44.135979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.136982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:44.137867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:44.137867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.137867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:44.137867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 279/576] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.137867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.163098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.163849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.164128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.164397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.174625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.176148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:44.190069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.191193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:44.192285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:44.192285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.192285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:44.192285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 298/577] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.192285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.221247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.239220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a097942-214e-4d0d-9c00-8b2c0dfcfb3a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.248156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.274348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.274938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.275218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.275490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.276176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.276479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.277937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.289941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 280/578] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.290807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.294095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1ad8-f184-4d49-b2fe-eb3ba9e14a3c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.327660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.328277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.328554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.328855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.336185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.337668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:44.348490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.349446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 299/579] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.350951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.395016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292665e-d7a1-4968-aced-c3e49e758701 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.429657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.430267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.430545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.430815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.441185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.442559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.444296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.450270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649271-a1c9-4a44-9fe9-98cc65f60293 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:44.456537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.459809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:44.460834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:44.460834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:44.460834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:44.460834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 281/580] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.460834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.465149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.485528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.486131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.486412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.486679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.487321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.487649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.489056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.500426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 300/581] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.501273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.558546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a92c-15fb-4f38-874c-086906961a1b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.591559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.592143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.592419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.592711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.593346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.593644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.595003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.602145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051649-c440-4a00-9462-5c7e73964087 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.607382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 282/582] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.608168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.639350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.639945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.640219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.640487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.641237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=285d5d20968a4dfe9c764fd09cc4ed4b) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.641546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.642983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.648277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 301/583] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/role_assignments?user.id=285d5d20968a4dfe9c764fd09cc4ed4b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.649067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.666954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.704315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.720923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112d53-78ba-4866-86ea-48007bfd6748 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.758539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.759157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.759423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.759685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.760430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.760762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.762238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.770688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a31233-94b0-4139-9f3b-3d1fe77a9eb6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.787892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 283/584] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.787892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.823691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.824538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.825029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.825434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.826248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:44.826693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.828213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.844712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 302/585] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:44.844712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.905693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de8cd-7988-4e6a-9984-be0e215fdd47 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.919470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.940746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.941456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.941793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.942125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.949648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:44.951886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:44.954837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.958893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2036-dd93-4fbd-a3f2-cf5eb0ac51be None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:44.964087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:44.969270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 284/586] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:44.970188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.997673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:44.998390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.998664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.998929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.006165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.008478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:45.020547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.021678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 303/587] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.023491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.081434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c0187-01d2-44ea-827d-9c064d4996e0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.119564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.120330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.120739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.121105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.127181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c250c-3d50-45e6-a24d-7324389ce24a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.132808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.134351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:45.149347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.150491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:45.151374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:45.151374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.151374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:45.151374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 285/588] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.151374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.169266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.169883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.170218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.170423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.177935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.178840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.179801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:45.191632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.192589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 304/589] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.193836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.217732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.262763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef419f9-9953-4fb1-ba06-bcc3f3a72255 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.301352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.302021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.302224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.302492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.303173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.304081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.305459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d144cd-fb10-4545-95c0-2e4c85dbc012 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.305570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.325041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 286/590] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.326662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.340614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.341237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.341519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.341787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.342513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.342813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.344249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.367291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 305/591] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.367291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.424297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.441369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2e4b-1b2a-43a4-8e57-bb24b8f27d0e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.449924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.473576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d98d9-d08d-402b-91e0-80261327a92a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.479770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.480368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.480642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.480940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.481642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.481942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.483304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.495345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 287/592] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.496132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.515434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.516032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.516307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.516579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.517367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:45.517671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.519187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.540712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 306/593] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:45.540712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.608109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300b8d-ef7f-4870-b158-57b34c6df82f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.642979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.643873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.644317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.644589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.654904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3cc6-d504-4f8e-85f1-82c2ffc5ad65 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.660588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=200f4c80511443c4bc7315a450a917e3, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.662159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.664675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.690979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.691599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.691874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.692179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.695209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.703625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.705244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:45.720584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.721636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:45.727854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:45.727854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.727854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:45.727854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 307/594] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.727854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.761234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 288/595] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:45 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:45.762619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.871360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e1b37-7ed2-4eef-8a37-e1fc221ce297 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.895711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89aa6-41cd-4942-aa3d-0b158449bcc0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.916580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.918095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.918594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.918965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.928587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.930962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.941878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.942711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.943134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.943548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:45.946992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.948012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:45.949181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:45.952818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 308/596] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.953754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:45.958516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.960590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:45.978249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:45.979408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:45.980582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:45.980582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:45.980582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:45.980582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 289/597] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:45.980582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.011295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.051420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.069922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570840-fe5f-4a71-9618-8134c799fb4d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.110070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1dc5-75be-4c6f-9b95-cc5a8e34a9a2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.115072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.115682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.116797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.117076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.117731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:46.118093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.119478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.132973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 309/598] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:46.133930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.152221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.153207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.153672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.154352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.155228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:46.155667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.157425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.176369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 290/599] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:46.177841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.249134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5477d6-aae1-45fb-96a8-908c2266adb6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.259640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.298255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.299026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.299304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.299571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.300519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:46.300856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.302732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.320067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13817954-c54f-4398-8ac0-d9190bca88e7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.325301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 310/600] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:46.326218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.329843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.364157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.365383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.365660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.366647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.374918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.376446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:46.389745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:46.390680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:46.391606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 291/601] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:46.392098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.448214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab10328-79c5-4cf7-b322-60f80369f539 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.486212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.487328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.487822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.488306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f8125d6e3bd74258be79e477260a977b/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.499638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61e3d7-3768-449d-a8d7-4376be427649 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.505465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=f8125d6e3bd74258be79e477260a977b, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.508009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.537029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.538314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.538598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.538861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.546000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.547430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:46.560693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:46.561820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:46.562765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 292/602] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:46.563271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.592706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.608735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 311/603] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:46 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f8125d6e3bd74258be79e477260a977b/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:46.608735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.661056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.691311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936106b-1c24-4304-97f3-be729c9962e3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.733573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.734407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.734972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.735119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.735917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:46.736322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.737934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56839-7d1e-4455-9044-e79401f35155 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.755507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 293/604] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:46.757370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb3376-fb66-47ed-84e2-15b49f1bdd04 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.757719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb3376-fb66-47ed-84e2-15b49f1bdd04 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.758078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb3376-fb66-47ed-84e2-15b49f1bdd04 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.759697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 294/605] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:46.764981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb3376-fb66-47ed-84e2-15b49f1bdd04 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.769985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d422-ac66-4b09-9502-e3efdf3eb2e4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.816075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.816815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.817097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.817369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.818128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:46.818438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.820594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fbeb-1602-4ebe-8bec-c101f6f935e8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.833700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 312/606] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:46.835662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.835959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.836344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.855713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:46.857354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:46.888438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.909907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb3376-fb66-47ed-84e2-15b49f1bdd04 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.941567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 313/607] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:46.942785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.953396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.954065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.954342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.954613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/136f5fbf04ab4000b0c80f1955f6515b/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.957165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.975637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=136f5fbf04ab4000b0c80f1955f6515b, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.977357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:47.078353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac8630-8fad-4a78-9d2f-0de54c35f700 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.099178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 295/608] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:46 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/136f5fbf04ab4000b0c80f1955f6515b/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:47.121169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.121864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.122137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.122409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/01a1375198434203bce21325c7b82c66/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.145495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=01a1375198434203bce21325c7b82c66, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:47.147617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:47.243071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 314/609] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:46 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/01a1375198434203bce21325c7b82c66/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:47.299754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.416887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35313b42-3ea4-4153-bb6b-7a92a3929328 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.458622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.459237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.459541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.459867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.463000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:47.471948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:47.477809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:47.478746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:47.480132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 296/610] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:47.487030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.559666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:47.608520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0788-dce1-43c0-aca8-a1175670443d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.650980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.651644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.651959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.652234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.652929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:47.653226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:47.654869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:47.668555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 315/611] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:47.674160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.827975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807135-ad1b-4a04-9a52-c8029a3beaa0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:47.877063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:47.878068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.878565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.879034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.898111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:47.899884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-e04288e6-ad5c-46b5-9f93-fb7f5ccdce8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:47.920744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:47.921733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:47.922634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:47.922634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:47.922634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:47.924836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 297/612] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:47.930583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:47.977307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168528-a081-4e68-9bd6-f92b373a875c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.977638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168528-a081-4e68-9bd6-f92b373a875c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.977848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168528-a081-4e68-9bd6-f92b373a875c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:47.979451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 298/613] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:47.984320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:47.984599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:47.984904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.002789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:48.003971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:48.065039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.081087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 299/614] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:37:48.143343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87266-add3-4534-8964-a14b2772c617 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.169732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.189176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.189711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.189990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.190260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.190900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.191198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.192559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.207148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 316/615] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:48.213368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.330248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9760e-5a30-493a-bb5e-53bb059af526 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.380426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.381078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.381424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.381709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] PATH_INFO: `/v3/users/swift` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.388946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.390376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:48.402429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:48.403394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:48.404598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:48.408349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 300/616] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:48.409698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.462634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.539172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.622553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa7e08-8746-48c1-9d1b-7e44ea84f58f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.661489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347ad0-fda6-49d6-8a6d-883db51bbcab None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.696779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.697389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.697662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.697925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.702582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:48.702895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.705466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.731516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.732063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.732337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.732599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.747009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 317/617] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:48.753404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:48.758991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:48.759920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:48.760783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:48.762031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.764761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 301/618] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:48.765827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:48.815081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.931517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2139b8-c6d3-4cdf-a656-8543fc4b35ab None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.956413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.961532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e8a5d-2af5-428e-94b5-87711d14a486 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:48.967966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.968589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.968907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.975166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.979909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:48.981637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:48.997056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:48.997652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.997945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.998188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-b11da3a7-44fd-4587-a711-cf2cce66a6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:48.998580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.000443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:49.002354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:49.002354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:49.002354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:49.002701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.002701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.002701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53485705-7a11-4088-b8bd-533cd1305f9b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.008702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 318/619] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.008702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2b3c-84b7-4488-9692-fbccc90a9d82 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.008702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2b3c-84b7-4488-9692-fbccc90a9d82 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.008702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b2b3c-84b7-4488-9692-fbccc90a9d82 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.008702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 319/620] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:49.009613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b2b3c-84b7-4488-9692-fbccc90a9d82 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.015147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 302/621] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.016503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.016826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.017084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.037511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:49.038839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.106622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.120747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 303/622] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:49.120969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b2b3c-84b7-4488-9692-fbccc90a9d82 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.122148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.156819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.157422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.157695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.158342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.158604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.158905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.160270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.184074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 320/623] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.187153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.283161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.301306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86292-4e2e-49a6-868b-d9c45c5bf57f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.367878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.368505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.368804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.369069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.385256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb730-c99f-49e2-8275-52fd4b9a12a3 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.398050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.399517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:49.425836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.426838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:49.427733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:49.427733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:49.427733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:49.430975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 304/624] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.432245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.432903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.433185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.433437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.434769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.445496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.446963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-fbf6e4b3-97e2-4926-a9f3-0862daed8e59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:49.468616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.469595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:49.470511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 321/625] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.471485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdfc7-5f81-4e81-bf12-c7f5d2f44666 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.471693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdfc7-5f81-4e81-bf12-c7f5d2f44666 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.471968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fdfc7-5f81-4e81-bf12-c7f5d2f44666 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.473334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 322/626] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:49.478247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fdfc7-5f81-4e81-bf12-c7f5d2f44666 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.489473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.559975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0e815-3187-4870-ba3c-6816b41dfa6b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.580596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fdfc7-5f81-4e81-bf12-c7f5d2f44666 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.592835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.593424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.593696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.593961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.594592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.594888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.596256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f1f8-21d6-475a-8af5-75130699b6c7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.608198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 305/627] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.609424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7be7-9794-4e61-9d76-d9e45c940c16 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.609695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7be7-9794-4e61-9d76-d9e45c940c16 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.609967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7be7-9794-4e61-9d76-d9e45c940c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.614710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.615332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.615608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.616480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.616906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.626825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:49.628913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-88cc7be7-9794-4e61-9d76-d9e45c940c16 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:49.630210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-88cc7be7-9794-4e61-9d76-d9e45c940c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:49.632872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.633978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 323/628] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.635003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.701027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 306/629] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:49.701243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.702252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f549c-f2df-4343-9b59-af70a4747e5f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.702531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f549c-f2df-4343-9b59-af70a4747e5f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.702799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f549c-f2df-4343-9b59-af70a4747e5f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.704006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 307/630] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:49.704847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f549c-f2df-4343-9b59-af70a4747e5f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.743378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853b6f-6102-428a-859f-733291cdeb51 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.778624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.779565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.779847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.780115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.780831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.781133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.782567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.801540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 324/631] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.801540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.826475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f549c-f2df-4343-9b59-af70a4747e5f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.861206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.868434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.873278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.873278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.873278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.879174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.881107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8d64707c-bb02-4b94-ab81-b92526c39444 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:49.896641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:49.898169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 308/632] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.904450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.905236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.905313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d47c7-9948-4bc2-93e4-012337f3862a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.923905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:49.925143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.934179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.941666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.942517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.942813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.945868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.945868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:49.945868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.945868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.958045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 325/633] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:49.958045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.001395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 309/634] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:50.002300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.071929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd283a-61be-4e60-844b-fd604c31d8f2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.108989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.109366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b44f-ce6e-466b-955c-0a9687a1339d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.109648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.109958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.110241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/285d5d20968a4dfe9c764fd09cc4ed4b/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.126015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=285d5d20968a4dfe9c764fd09cc4ed4b, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.127607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.131878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.142950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.143548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.143825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.144093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.144833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.145136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.146553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.165312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 310/635] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.165936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.204903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 326/636] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:37:49 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/285d5d20968a4dfe9c764fd09cc4ed4b/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:37:50.204903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.260375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.291604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0771e-7f92-486a-9183-921cea6199ab None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.328319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941dbf-3ac4-4547-a2bc-e2f98d49488d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.329953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.330698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.330976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.331243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.343819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.345618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:50.363908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:50.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:50.369769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:50.369769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:50.369769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:50.369769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 311/637] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:50.369769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.373451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.374089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.374364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.374632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.387024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:50.391900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:50.392955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 327/638] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:50.394087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.405487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.479870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca980-b235-482c-ba66-a3f942bd523e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.497066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.500712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7fd1b-6f11-4023-9714-0e6b96c32f78 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.515855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.516474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.516768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.517037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.536193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.536852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.537131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.537400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.547595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:50.552486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:50.554392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 328/639] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:50.555249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.594481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.595872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.627216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.669579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f594-8bc8-4f7a-9661-38ea2f4f09cf None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.701765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 312/640] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:50.706752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.706918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.707670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.707951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.708224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.708906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.709210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.711317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.728144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 329/641] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.728144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.748971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.819550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80bc-7deb-4f70-8a97-0c6af24c3639 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.842559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3014-c1ab-4e57-bad6-036f76a2d76c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:50.852163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.857228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.858737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.859015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.859287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.859948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.860251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.861723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.875402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 313/642] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.876244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.879584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:50.880510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:50.880836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:50.881098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:50.881818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:50.882265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:50.883692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:50.892285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 330/643] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:50.893097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:50.983885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:50.985210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c228c-4650-4dfd-81ed-1fe20edf4ec3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.004501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec09eb-c217-4ff3-aff6-00fe849dc56c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.019906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.020522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.020829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.021145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.032992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.034910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.040547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.041393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.041823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.042244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.051339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:51.051613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.052838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:51.054377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:51.054377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.054377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:51.054377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 314/644] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.054718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.056249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:51.071019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.072215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:37:51.073519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:51.075390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 331/645] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.076377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.113084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.170487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d5ab7-a496-4d3d-9584-359beabff62f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.186115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5918-1ae9-4e06-9b08-117a68fdd225 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.212040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.213021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.213299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.213570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.223881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.224409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.224537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.224806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.225181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.225937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.236684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.238132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.240033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:51.240349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.241560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:51.242493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:51.242493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.242493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:51.242493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 315/646] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.242493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:51.255538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.271904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:51.273089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:51.273089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:51.273089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:51.273089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 332/647] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.273089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.352919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.357411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c700-9864-48f9-8d83-8b64fdb6ac8a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.368806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb42-5c75-4be9-9006-7507c0283169 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.392940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.393540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.394188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.394463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.395110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.395651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.398300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.402767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.403362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.403646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.404174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.404925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.405235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.406678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.414554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 316/648] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:51.414554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.424948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 333/649] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:51.429598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.487051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.524113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6f626-06f1-44ff-aed3-8d56981a7473 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.536245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873654b-7072-4dd4-b00d-c875551c83fe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.558485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.559083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.559359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.559624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.560256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.560553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.561958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.574463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 317/650] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:51.575615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.580485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.581294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.581576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.582671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.583335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:51.583639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.585887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.597931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.603568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 334/651] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:51.603568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.687462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d918-24c6-4c21-8f92-e3d872fa5a44 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.716704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cb414-b38a-4343-a661-2760568f6cfb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.727338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.727965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.728595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.728904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.731133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.736915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.738406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:51.750776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.751803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:51.752811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 318/652] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.753328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.757896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.758507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.758784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.759048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.839914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.842270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.842767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.863770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aae952-1a64-47f6-87f4-8666344cbb1e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:51.900835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:51.901457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.901734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.902003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.910540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:51.911981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:51.924046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:51.925232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:51.926199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 319/653] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:51.926796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.953897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 335/654] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:51.954986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:51.969674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.036465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f9bec-5a67-48f4-9be7-543b7a75650e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.072142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.072801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.073079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.073349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.076468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b3749-f4b6-4c60-9e10-d37641268673 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.081115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.082546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.084909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:52.095180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:52.101280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 320/655] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:52.102274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.118544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.119372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.119855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.120268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.121149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.121618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.123178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.135702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 336/656] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:52.136783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.210305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.213525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e4f5d-b2ed-40bc-81fc-a5f0ce8942f6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.238589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36a9a-e00d-4bdd-8136-d2a54d2184e8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.246751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.247571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.247851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.248120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.248869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.249169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.250604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.267691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 321/657] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:52.268466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.278105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.278982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.279257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.279528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.291165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.292596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:52.306716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:52.307700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:52.308590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:52.308590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:52.308590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:52.308590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 337/658] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:52.308590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.328749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.373876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e94c22-ea84-46bc-9e56-aa343ec134a6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.407818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.408416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.408713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.408985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.409703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.410005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.410923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5408b-57e4-4b20-ab16-a94e1f137a15 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.411431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f862a8-6a22-45d3-a3b0-2e3df6202b12 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.430101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 322/659] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:52.431302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c668d-e051-4fac-a609-f4c04f9e7c3c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.431581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c668d-e051-4fac-a609-f4c04f9e7c3c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.431843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c668d-e051-4fac-a609-f4c04f9e7c3c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.433050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 323/660] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:52.433743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c668d-e051-4fac-a609-f4c04f9e7c3c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.438833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.449522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.450119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.450396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.450664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.451387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.451690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.453153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.458744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 338/661] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:52.459747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.558858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c668d-e051-4fac-a609-f4c04f9e7c3c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.571772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738609-233f-4e7d-b273-91348d7632fa None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.575341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.598605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.600390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.600390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.600390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.610007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.610605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.610881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.611147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.612100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:52.612100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.614302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.627002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 339/662] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:52.627814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.685425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.689137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.691164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e4bd-3055-487c-8d61-f96121c75eef None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.739984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326ea5-5fe9-4ca6-bf4b-d483921ceca5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.776129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.776763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.777046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.777317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.811217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 324/663] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:52.812403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.812696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.812968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.831514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:52.832721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:52.844758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.860189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.861685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.907946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 325/664] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:52.908585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.924713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.985287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 340/665] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:52.986339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.034453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32b177-050b-4cdf-a1ef-7d9e664ba946 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.079759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.080384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.080562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.081232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.089623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.091641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.102271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a423-69c3-4dbc-a155-7513416b3bae None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:53.106461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.107371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:53.108251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:53.112247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 326/666] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.113096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.119003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.150444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.151828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.152540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.153075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.169578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.171043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.183074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:53.194337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.197089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:53.197986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:53.197986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.197986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:53.198971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 341/667] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.200202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.234873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a554-39cb-44cb-b9c1-0a677d82a6e1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.271256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.272606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.273124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.273414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.284492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.285966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:53.300136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.301144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:53.302054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:53.302054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:53.302054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:53.306226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 327/668] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.307056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.312328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611011-df60-4c0b-be15-1f47b5313245 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.350330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.350868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.351162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.351425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.352077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.352377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.353856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.363869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.366153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 342/669] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.371569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.412082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb397b0-1f60-4569-afea-673f781d418a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.438347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.446379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.446999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.447274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.447545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.457949 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:53.463707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.464620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 328/670] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.470197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.489405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d81e-9b6e-4fff-b170-0766daa65d70 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.529286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.529894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.530176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.530626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.531092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.531397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.532805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.548810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 343/671] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.549997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.576055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285066-ae1f-4562-9a26-bb93f628ecfe None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.593427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.612224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.612926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.613205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.613726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.614239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.614542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.616567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.629575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 329/672] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.630745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.679144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7623b-b6ca-40bf-881b-03202535fd94 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.703091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.720311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.721100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.721429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.722079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.723081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f8125d6e3bd74258be79e477260a977b) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.723394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.725874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.732175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 344/673] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/role_assignments?user.id=f8125d6e3bd74258be79e477260a977b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.732991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.750959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8297b-9bd7-4d0b-846b-050b40d15572 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.811063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.812048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.812623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.813130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.814139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:53.814734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.816360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.831565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 330/674] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:53.833022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.876337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607374-eb0c-418f-afad-ba4efbb5c0fa None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:53.882508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:53.917937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:53.918563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:53.918836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:53.919722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:53.932011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:53.933509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:53.946583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:53.947522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:53.948410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 345/675] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:53.948930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:53.959311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3a37-e399-4712-b5a2-ee423fb35e04 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.003902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.017453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.018704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.019131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.019405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.027945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.029744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.079382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e4b6-42a7-4fb8-b161-b838f81dab00 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.119987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.120643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.121038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.121389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.134644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.136170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:54.152032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.153080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:54.154261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:54.154261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:54.154261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:54.156958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 346/676] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:54.157756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.159666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:54.160964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:54.161719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.161879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 331/677] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.165674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.269388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.274096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8236-70b8-4a91-9ae2-a5ef54866698 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.289561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.296785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c619-8442-4042-acf8-4dfd2fbb00ca None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.317969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.319171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.319421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.319760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.321045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.321350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.322758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.338463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 332/678] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.340385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.349239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.350830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.351108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.351378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.352079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.352382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.353863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.367434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 347/679] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.368180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.468252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d235-86f2-4620-8bde-f2c7100eb78a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.503521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65529-f0a8-48cf-a4cc-ef7091799320 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.504953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.505737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.506147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.506514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.507629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.507751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.509310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.522378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 333/680] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.523536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.543928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.544578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.544889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.545161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.548444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.552309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.554505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-b86a2d0e-c8e6-4daf-8b9f-190c33cdb962 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:54.566028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:54.567288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 348/681] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:54.568277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee12c-c2c9-4988-8bad-6802ac26a439 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.569763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee12c-c2c9-4988-8bad-6802ac26a439 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.569763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee12c-c2c9-4988-8bad-6802ac26a439 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.572706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 349/682] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:54.572706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee12c-c2c9-4988-8bad-6802ac26a439 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.593928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.643582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daabe25-5ea6-402c-a96b-1cab4b4af6d2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.681541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.682131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.682409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.682676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.683413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=136f5fbf04ab4000b0c80f1955f6515b) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.683760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.685249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.701061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 334/683] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/role_assignments?user.id=136f5fbf04ab4000b0c80f1955f6515b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.701862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.708651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee12c-c2c9-4988-8bad-6802ac26a439 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.752559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.753310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.753656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.753997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.754872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=01a1375198434203bce21325c7b82c66) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.755244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.757780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aca5f-d3b1-4d55-9bd9-bd111b7a80b9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.765067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 350/684] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/role_assignments?user.id=01a1375198434203bce21325c7b82c66&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.766480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.766838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.767176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.788295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:54.789746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:54.831688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.852013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17487-38cc-45ef-b27c-2a09a646d60e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:54.892275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:54.893067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.893413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.893751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.894635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:54.894886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 351/685] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:54.894989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:54.900714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:54.920821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 335/686] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:54.928639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:54.942106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.053318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f19b1-3375-4087-876a-b3d820394775 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.090573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.091237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.091515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.091776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.163605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.165092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.176532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.200869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.316653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 352/687] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:55.335839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.347237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494837a-7208-4457-a1c2-1d35d045a59d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.385579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.386213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.386671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.386943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.399079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:55.404406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:55.405385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:55.406224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:55.406857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 336/688] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:55.407375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.414163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.509346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da7aaa-7c4e-4cf2-9ada-19981d0b62cb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.521369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.544998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f3c5-a2e2-4520-8174-75a2fc0499e1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.568990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.569548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.569832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.570105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.597674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.599156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.601468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.602076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.602355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.602624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.603287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:55.603586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.604965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.623617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 337/689] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:55.628589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:55.629545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:55.630455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:55.630455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:55.630455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:55.630455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 353/690] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:55.630690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.637416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.701094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.762835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31d11-ace0-47f6-a89b-8b3e4e992f5d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.794591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4a21-eeae-4651-b4d7-872e51cefb77 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.839506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.841236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.841529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.841806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.843081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:55.843400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.846688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.847308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.847586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.847856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.848290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.869947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.872297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.874790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 354/691] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:55.880454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:55.901359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:55.902478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:55.903386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:55.903386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:55.903386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:55.903386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 338/692] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:55.908454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.926408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.027681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b3a1a-c6b7-4dd4-af7f-2c1aded319b7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.043370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.047313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bd3b6-ab26-4486-95da-b04ba12efe48 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.066153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.066764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.067041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.067310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.067954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:56.068253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.070486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c75b-a650-48d2-8496-923f80e08316 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.083909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 339/693] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:56.085418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee354-fb63-444d-9d3b-fbe729aa55f1 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.085796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee354-fb63-444d-9d3b-fbe729aa55f1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.086072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee354-fb63-444d-9d3b-fbe729aa55f1 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.086686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.087558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.088088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.092321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 340/694] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:56.092321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ee354-fb63-444d-9d3b-fbe729aa55f1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.092867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.100528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.102314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c7ac9501-cbc7-43b2-802f-18176eb2d0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:56.114101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:56.115005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:56.116479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:56.118870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 355/695] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:37:56.120406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.120922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.121398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.143510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:56.144999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:56.214238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ee354-fb63-444d-9d3b-fbe729aa55f1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.236919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 356/696] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:56.238446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.257053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.257053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.257053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.257053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.261813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.273906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.275355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:37:56.295764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:56.296771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:56.297730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 341/697] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:56.302444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.389553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874af8f-d4ba-46dc-810e-08314391bfa9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.407127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.430316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.430929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.431203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.431467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.432162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:56.432718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.435589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.449344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 357/698] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:56.455091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.548047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8138-3b8e-45b2-a026-52047ce5510c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.580207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.595497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.599762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.613756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc1a4a-6680-4057-b7ec-ef40563411a6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.620854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 342/699] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:56.622112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.661448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.661960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.662291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.662557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.663290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=285d5d20968a4dfe9c764fd09cc4ed4b) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:56.663593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.665088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.676835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 358/700] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/role_assignments?user.id=285d5d20968a4dfe9c764fd09cc4ed4b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:56.678420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:56.751043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f9b10-e50c-4b1f-9c02-8291d5cac48f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.765033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.790189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4cbf-a9cc-44f4-9a36-4c413147e295 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:56.797569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.817343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.817668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.817910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.828808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:56.829463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:56.829743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:56.830012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:56.834681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:56.867845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.869361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.908697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:56.910230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:56.914008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:56.915026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:56.916088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:56.916088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:56.916088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:56.916088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 343/701] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:56.923311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.017664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 359/702] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:57.024342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.036879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7b9c-4aab-408d-9320-7af5ff81d72b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.060859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.075552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.076825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.076825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.077365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.078218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:57.078743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.080343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.093601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 344/703] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:57.100031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.105019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.132287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ada1-cae7-478d-9236-e1cf5cb242f1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.169300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.169853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.170134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.170477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.181633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.183098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:37:57.200459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.201514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:37:57.202446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:37:57.202446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:37:57.202446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:57.202446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 360/704] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.207736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.216136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b82ea-6e6a-455f-b03f-43a4abebcc73 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.258870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.259835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.260345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.260861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.261731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.263872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe79c2-3c58-4076-8619-9a8aa6e382f5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.316750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.328435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33ebe9-9dd3-48c4-b074-d7face72176e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.351320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 345/705] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/users => generated 254 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:37:57.352800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d808-cfab-4e10-b353-48626660b343 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.353154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d808-cfab-4e10-b353-48626660b343 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.353506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d808-cfab-4e10-b353-48626660b343 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.355008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 346/706] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.359822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3edd-cbef-44b0-a2d5-5d605e5fba87 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.360103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3edd-cbef-44b0-a2d5-5d605e5fba87 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.360503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3edd-cbef-44b0-a2d5-5d605e5fba87 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.363181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 347/707] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.364530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.364927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.365296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.376076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.377072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.377558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.378031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.378904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:57.379412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.381050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ce08-e1a6-43a4-b28e-998a6d72ad05 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.386109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.387501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.401520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 361/708] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:57.402865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.403215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.403862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.425912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.427182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.454390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.468217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 348/709] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:57.471907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.547503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 362/710] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:57.594735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c4ad-9981-4552-80ce-974ed40571eb None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.629243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.629867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.630139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.630406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.637657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.639103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:37:57.651693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.658909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:57.659836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 349/711] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.660360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.746671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.771873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a66e-43ce-462e-9c31-6a9d3453eed2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.794028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.813153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.813153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.813153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.813505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.814121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:57.814421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.815985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.831175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 363/712] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:57.836446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.875456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.933285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f2f4-a01a-4876-acc8-44af7ba3a3e1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.955457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c008-72a8-4562-a9fc-413ec87b234e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:57.970656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.971542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.971816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.972082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.972935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:57.975371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:57.989701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:57.990845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:57.991865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 350/713] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:57.993439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:57.998243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:57.998791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.999068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.999334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.000068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.000375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.001953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.016993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 364/714] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:58.018134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.027848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.117873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cf5ff-a2fa-4dbd-8d6f-08b09598c8f2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.137052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.162883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.163703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.164044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.164374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.165079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.166536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:58.177370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:58.179048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:37:58.179957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:37:58.183684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 351/715] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:37:57 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:58.187331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.275932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb242-6deb-40fd-af58-41b67b613fb6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.344441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.345130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.345412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.345673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.346306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.346600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.347965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.356729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 365/716] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.362126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.376693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5300-e19f-45ad-b66d-86fe0694b9b7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.433372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.445549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.446164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.446443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.446716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.447353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] RBAC: Adding query filter params (name=network) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.447658 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.449053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.463557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 352/717] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:58.469401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.470947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c9fe-ac07-4d3a-ba09-ec8ddb48caa7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.512016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.512626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.512932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.513201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.513837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.514137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.515801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec596cdc-01ea-48c3-9226-619de6c43279 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.523704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 366/718] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:37:58.569140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.654814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45b51-a735-45c6-9973-b80584ff945c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.694203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.695157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.695620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.695915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.696589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] RBAC: Adding query filter params (type=network) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:37:58.696924 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.698330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cf302-711b-4e64-99c0-8fa93fe18d07 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.704965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 353/719] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:37:59.147892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df796-e3d5-42be-81b4-d98931e14093 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.148279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df796-e3d5-42be-81b4-d98931e14093 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.148488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df796-e3d5-42be-81b4-d98931e14093 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.149805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 367/720] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:59.155230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.155523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.155804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.181721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:59.182987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:59.275295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 354/721] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:37:59.594166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168df796-e3d5-42be-81b4-d98931e14093 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.717941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168df796-e3d5-42be-81b4-d98931e14093 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:59.792139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:59.807278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:59.807278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.807278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.807278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.829572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-6b554253-cbff-4f47-9125-21170a270e9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:37:59.835265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:37:59.836199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:37:59.837081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 368/722] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:37:59.844109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:59.868341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884629-005d-4310-a8db-d1fce6cc9c18 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.868645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884629-005d-4310-a8db-d1fce6cc9c18 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.868937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e884629-005d-4310-a8db-d1fce6cc9c18 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.870280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 369/723] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:59.876027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:59.876362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:59.876572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:59.902984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:59.905799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:59.921018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.003681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171c581-2f2a-4384-954b-024f30a22542 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.041593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.042207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.042549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.042830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.043495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:00.043796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.045324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.054478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 355/724] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:00.060274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.066591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 370/725] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:38:00.166640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.170960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04593-3e4f-4f9d-86d0-00ddc9cb1bed None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.206608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.207235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.207513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.207856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.218501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.219990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:00.236124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:00.237138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:00.238028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:00.238028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:00.238028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:00.238028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 356/726] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:00.245166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.367342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7e7f-6aa2-449b-af6b-518e9bbd7ec0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.400687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.410773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.414038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.414038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.414038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.414038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:00.414038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.414418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df968-f6d2-4715-b7fc-2c1a3bd2d595 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.436255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 371/727] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:00.445789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.484945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809b49f-da44-45f3-b4c9-b00ed9baead7 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.485602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809b49f-da44-45f3-b4c9-b00ed9baead7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.486264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809b49f-da44-45f3-b4c9-b00ed9baead7 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.488643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 372/728] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:00.495383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.496372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.496839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.519921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:00.521844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:00.603642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fba60a-4f8a-4860-8d88-f41f6186da88 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.607701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 373/729] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:38:00.609186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.653137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.659882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.659882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.659882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.673117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.674575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:00.697454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:00.698431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:00.699390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 357/730] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:00.706200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.727690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.770014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d061cd-7b28-43d1-b7e8-6d67a75bc40e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.792637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.836762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.837403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.837682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.837954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.858662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:00.863534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:00.864738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:00.866050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:00.871282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 374/731] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:00.875805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.918356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a09-a24f-4980-a12a-ebb74428e945 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:00.960862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:00.961825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.962331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.962676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.963411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:00.963724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:00.965438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:00.984198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 358/732] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:00.985165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.012103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9fcaa-9701-4493-bf0c-ddb521397fb4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.050205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.050966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.051249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.051518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.052191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.053084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.054465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed8828-00ce-4dce-ab79-867ec1893937 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.058603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.062888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 375/733] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:01.063991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8192bf-9a64-43f6-9005-a16c8b71c4de None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.064279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8192bf-9a64-43f6-9005-a16c8b71c4de None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.064551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8192bf-9a64-43f6-9005-a16c8b71c4de None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.065875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 376/734] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:01.066461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8192bf-9a64-43f6-9005-a16c8b71c4de None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.102375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8cef-a8b6-44ec-b6ed-ea183d6f660f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.104129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.137591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.138216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.138493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.138763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.150388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-cd7514e8-a3d0-49b7-963d-c782ee794c47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:01.156707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:01.158681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 359/735] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:01.160425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.162898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.162898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.178201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:01.179396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:01.190514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8192bf-9a64-43f6-9005-a16c8b71c4de None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.227145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.227657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.227935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.228211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.256711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 360/736] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:38:01.256711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.319591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.321481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.334859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.356771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.386246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1fd3b-8d41-4243-9581-d464a4d2e805 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.424594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.425748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.426292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.426801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.438541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.440443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.449428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 377/737] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:38:01.450501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8333ad10-7f4c-44c5-9bdc-ebfd18fc01c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:01.461782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:01.462753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:01.463668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:01.463668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:01.463668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:01.463668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 361/738] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:01.464362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e52d-73c0-4fe5-bee5-0525c64d8a3d None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.464461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e52d-73c0-4fe5-bee5-0525c64d8a3d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.464700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e52d-73c0-4fe5-bee5-0525c64d8a3d None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.466155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 362/739] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:01.466977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e52d-73c0-4fe5-bee5-0525c64d8a3d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.566506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c8e9-cb51-41c0-9313-926d02b38250 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.574225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e52d-73c0-4fe5-bee5-0525c64d8a3d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.585346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.596593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.601460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.602065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.602344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.602612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.603280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.603582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.604984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.608987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.609607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.609883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.610151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.613428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 378/740] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:01.614002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.622737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.624197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-273a83f3-f4df-4442-b85c-7464ea91d182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:01.639839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:01.640972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:01.641912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:01.641912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:01.641912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:01.641912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 363/741] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:01.642443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.642604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.642872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.662183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:01.663716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:01.729113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 364/742] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:38:01.729918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.785092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71f77-3b34-4043-8a80-5cb1556504a7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.823675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.824207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.824484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.824799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.825444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:01.825773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.827146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.840714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 379/743] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:01.840714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:01.862676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.874254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c83b-73d7-4095-9dac-4c3faf65c2bc None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.897497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.911442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.912849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.913315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.913583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.914235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.915717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.943840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3559b-7dbc-40c8-b13f-3eec7b8017f1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.982993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.983618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.983898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.984165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.994419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.996003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.008481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 365/744] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:01 2022] POST /identity/v3/services => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:02.009966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:02.010955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:02.011879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:02.013233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:02.013233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:02.013233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:02.013233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 380/745] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:02.013233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.135206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d244c-d1e5-4e7b-9a09-9a90850c823c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.143504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.155003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082cc8-334c-4ccd-a543-649ae90075ff None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.174250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.175500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.175500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.176282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.185807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.187269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.196264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.196906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.197186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.197457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.198109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:02.198418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:02.199664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:02.200614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:02.201595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:02.202132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.202204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 381/746] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:02.202204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.216240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 366/747] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:02.221089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.233153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.316081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace837-0489-4c82-89ef-0bca1fa8bd80 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.351041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.351648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.351922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.352213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.352900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:02.353201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.354573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.362475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc163c-8e15-4c79-b17d-ff5e3d56634b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.372067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 382/748] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:02.372067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.400633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.401456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.401732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.402134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.402277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.403143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.404857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.476052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b656bc-aa79-4fed-b82b-42d21ceba7f0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.490649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 367/749] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:02 2022] POST /identity/v3/services => generated 240 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:02.491740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.529961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.531061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.531527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.532063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.533071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:02.533565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.535464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.566098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 383/750] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:02.567147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.589424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.627324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3141f-4a6d-4fa2-a052-3f80a0429ef1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.668855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.669059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.669599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.669799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.670101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.678465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.679950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:02.694250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:02.695187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:02.696322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 368/751] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:02.697099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.703102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7539813-b7e0-4305-a15b-da6a5d959292 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.748160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.749158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.749613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.750071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.758417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.760190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:02.773439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:02.774379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:02.775342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:02.777690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 384/752] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:02.779026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:02.826345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d54c-9497-475d-8ce0-1aef850444cf None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.863044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.874555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.881219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.881219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.881219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.897511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad5d4-e811-4bb0-8eeb-ef87f05eb922 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:02.944315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:02.944864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:02.945571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:02.945850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:02.946692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:02.947138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.948784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.960983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:02.963580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:02.965355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:02.968722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 385/753] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:02.969875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.087144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 369/754] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:03.088647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.111223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24759e-a15f-4329-962e-2ec39e2c7a08 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.122906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.162809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.163904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.164500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.165103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.166024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.166520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.168242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.188376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 386/755] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.189709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.211925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a314-50fc-4a3b-b0f1-6263ffad292f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.255592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.256826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.257328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.257863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.258768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=285d5d20968a4dfe9c764fd09cc4ed4b) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.259277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.259764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.261686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.267986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 370/756] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/role_assignments?user.id=285d5d20968a4dfe9c764fd09cc4ed4b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.269077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.339030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c57dcf-38e9-43b5-91a2-7da58b492fda None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.385071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.397271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba728-aa80-41f9-845d-3512a1b046ee None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.398182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.398845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.399126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.399398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.416231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.417749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:03.443497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:03.444803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:03.446342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:03.446342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:03.446342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:03.446342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 387/757] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:03.451213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.452900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.455828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.456296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.456747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.482123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.483821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:03.505183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:03.507149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:03.508246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:03.508246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:03.508246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:03.508246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 371/758] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:03.513203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.644474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a3297-d0f6-48f7-8565-ceae20b0beb6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.674921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abc084-7ba8-45dc-aff3-9791d56f0768 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.696728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.719517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.720129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.720401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.720682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.721348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.721643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.723010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.744242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.744890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.745169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.745438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.746085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:03.746382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.747754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.752928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 372/759] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.759181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.763178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.772447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 388/760] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:03.777747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.922779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00ea-52c9-4336-aed6-85b76e706c5c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.941798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d45e-e246-485b-8759-d4e60210412d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.958149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.959453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.959732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.960003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.976992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:03.979888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:03.993171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.993793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.994067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.994387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-363118ed-6351-4a9f-97f2-3ccfbff96b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:03.996558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:03.997461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:03.998391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:04.000762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 389/761] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:04.001259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.007490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406aca-b9b5-4305-8676-b39ab8131fcf None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.007620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.008205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406aca-b9b5-4305-8676-b39ab8131fcf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.008744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406aca-b9b5-4305-8676-b39ab8131fcf None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.010484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 390/762] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:04.011425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406aca-b9b5-4305-8676-b39ab8131fcf None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-702bb25e-ac1d-496a-9d4c-f96f34dd3a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:04.018916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:04.019862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:04.020813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:04.024799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 373/763] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:04.026157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.026437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.026694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.046355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:04.047790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.047927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:04.114306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.128697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 374/764] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:04.128697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.136471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406aca-b9b5-4305-8676-b39ab8131fcf None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.202397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.203248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.203709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.204123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.204999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.205446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.212701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.233130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ecc08-4adb-4974-89e3-aff2a1622c49 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.238219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 391/765] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:04.246424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.275626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.276287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.276569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.276864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.277613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.277914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.279657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.292250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 375/766] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:04.304790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.398815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.402050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36af2e-9dee-4077-93fb-4e75a91f3265 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.421137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.436556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.437193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.437473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.437744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.438478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=02588426fad84b17a81e738bafdac8d5) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.438793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.440235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.447155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 392/767] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/role_assignments?user.id=02588426fad84b17a81e738bafdac8d5&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:04.520470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.539136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd3ae5-bf52-4c07-a534-004728d6ec9d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.616780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.618492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.619065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.620136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.625137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=200f4c80511443c4bc7315a450a917e3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.627058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b24a8-4c95-4bac-924e-fd19d131a523 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.672338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6ee25-4d5c-4eb3-af1c-90040b976124 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.710731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.711442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.711724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.711974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.712559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.714019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.716066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 376/768] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:04 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:38:04.723446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff945fd-ca28-4875-9ea4-12216c67f4e5 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.724624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff945fd-ca28-4875-9ea4-12216c67f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.724959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff945fd-ca28-4875-9ea4-12216c67f4e5 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.726872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 377/769] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:04.736060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:04.737594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:04.738436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 393/770] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:04.739255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.739375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.739684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.754943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:04.776958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:04.776958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:04.789192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:04.858253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 378/771] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:04.940434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6788e-133a-46c5-9d24-6b0d5f2523a0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:04.983420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:04.984034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:04.984304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:04.984601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:04.985229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:04.985526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.986898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.993120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 394/772] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:04.999088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.062800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.136439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2e09-3b6e-4995-a484-8c0c6fa083d3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.180188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.180823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.181102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.181370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.182009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:05.182306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.183670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.189729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.190335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 379/773] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:38:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:05.196512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.310957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380f94-3a40-4d2e-8011-f84a1e0c6c8b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.321072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.337014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.368488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.369123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.369400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.369668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.370369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] RBAC: Adding query filter params (interface=public, service_id=e107e2a708a0470faedffd6caf6901d8, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:05.370679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.372045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.373569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce128c-802a-4e0a-bcdc-77be58e416fc None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.389889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 380/774] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:05 2022] GET /identity/v3/endpoints?service_id=e107e2a708a0470faedffd6caf6901d8&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:05.396702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.445813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.446454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.446734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.447003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] PATH_INFO: `/v3/services/network` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.447596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.449215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:05.459929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:05.460964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:05.461842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 395/775] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:05 2022] GET /identity/v3/services/network => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:05.469295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.601066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984bd53-3f9b-429b-9c11-d67a88328b27 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.643500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.644155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.644434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.644715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.645363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.647796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4177-2f59-4fc2-a2c7-b22fe72e1b2c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.654820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 381/776] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:05 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:05.656179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e626e-f63a-49a2-9170-c11bc555dc5a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.659180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e626e-f63a-49a2-9170-c11bc555dc5a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.659180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e626e-f63a-49a2-9170-c11bc555dc5a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.659180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 382/777] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:05.664563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.664865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.665144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.702490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:05.705087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:05.724716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eb093-f14f-41ca-90b1-69ebe4aba64a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.773102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.779960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.780577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.780875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.781142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.781780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:05.782079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.783489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:05.804839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 396/778] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:05.809104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:05.825951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:05.835724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 383/779] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:05.938740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4e9b-29ec-4385-b832-de74e9bebdb3 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:05.988132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:05.989120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:05.990266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:05.990970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:05.991855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] RBAC: Adding query filter params (type=network) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:05.992329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:05.993872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.004068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 397/780] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.005207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.129232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca71e0f-e1a3-4c9a-886a-b6f24b29dac6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.166268 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.166892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.167136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.167406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.168104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] RBAC: Adding query filter params (interface=public, service_id=8792c2f33a354d6b9d49fad1dc2419a1, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:06.168406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.169815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.176138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 384/781] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/endpoints?service_id=8792c2f33a354d6b9d49fad1dc2419a1&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.181819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.220114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.253308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.337038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.354989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91976c27-62aa-41a1-9d22-2f76fc6ed49b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.362692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f7a0-cf8f-473d-ae86-6894a2c2f915 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.405942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.406566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.406840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.407106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.429348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:06.434100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:06.435025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:06.435874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 385/782] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:06.444834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.453368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.453999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.454282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.454557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.455184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.460725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e516e-348b-431f-accf-c304ec3f2481 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.466580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 398/783] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.590064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.601155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3769-94ae-4952-b0fe-5ec51e605114 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.634472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a153e-ee98-4e15-9c98-f1f193365143 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.634881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a153e-ee98-4e15-9c98-f1f193365143 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.635030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a153e-ee98-4e15-9c98-f1f193365143 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.636500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 399/784] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:06.641855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.642116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.642288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.642408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.642872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.643572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.644440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.647220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:06.647220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.647730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.658394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 386/785] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:06.663741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.670774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:06.672245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:06.785702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 400/786] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:06.821421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c449759-be90-4a72-9f1a-f52527973632 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.862879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.863866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.864366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.865013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.878472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.881098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:06.905417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:06.906420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:06.907325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:06.907325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:06.907325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:06.909569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 387/787] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:06.915496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.007436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.052514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f074-b30f-4b93-99bc-8337bbed322f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.102776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.103383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.103658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.103928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.104580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:07.104902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.106271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.123417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 401/788] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:07.128719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.135488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.148818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.260026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2bac-4b8b-447f-89b9-a45a14107fcc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.303791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979f30f-07a0-476c-a1cf-74645b2d83b7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.310434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.311618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.311905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.312181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.325702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.327994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.333949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.342175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.342800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.352858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.352858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-9a0158d1-380c-4b0a-a96c-6d85d7c439cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:07.353028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:07.353944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 388/789] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f1d8-1e89-4ab1-857a-ce9b921982b2 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.354927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f1d8-1e89-4ab1-857a-ce9b921982b2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.355668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f1d8-1e89-4ab1-857a-ce9b921982b2 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.355668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 389/790] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:07.355668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8f1d8-1e89-4ab1-857a-ce9b921982b2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.364166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-3b4ca261-2ab1-4b2e-bf48-8b1c88682e91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:07.369632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:07.371872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 402/791] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:07.374108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.375810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.375810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.393165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:07.394465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:07.441085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.488701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 403/792] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:07.488701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.489913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8f1d8-1e89-4ab1-857a-ce9b921982b2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.558806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.559794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.560272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.560777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.561712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:07.562250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.563870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.594774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 390/793] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:07.605087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.689268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8f928-5d35-4ca4-8e10-398cb31aaceb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.726815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.758106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.758712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.758991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.759264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.759942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:07.760247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.769252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.783688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 404/794] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:07.790136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.829750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500b56f-3cc7-4e2b-8596-b19eb3571066 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.861967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:07.876953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.877682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.877967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.879214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.890010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.891829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:07.910118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:07.911117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:07.912345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:07.912345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:07.912345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:07.912536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfda3-cf4f-4f89-ab6d-acefeda08073 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:07.914337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 391/795] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:07.920196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:07.947460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:07.948013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:07.948287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:07.948592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:07.960316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:07.961812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:07.976499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:07.977670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:07.978786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:07.978786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:07.978786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:07.978786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 405/796] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:07.979045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.011696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.040058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d208a-c20c-411b-b2dc-ea11e466909e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.077710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.078329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.078606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.078873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.085458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e7787-fee1-4ab7-a1d0-eedb762df98c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.090109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:08.095366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.096515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:08.097611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.102130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 392/797] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.102603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.124050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.124653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.125104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.125391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.126040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.126343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.127722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f860ba-eda7-4876-8f1b-d57f281189ca None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.139920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.146538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 406/798] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.146538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d5c2-e0bd-40ef-ba01-cebf9eb57df7 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.146538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d5c2-e0bd-40ef-ba01-cebf9eb57df7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.146538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d5c2-e0bd-40ef-ba01-cebf9eb57df7 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.148795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 407/799] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:08.149751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d5c2-e0bd-40ef-ba01-cebf9eb57df7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.218147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cecc-fbde-4566-b1b2-12f8ef859a3c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.251771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.254262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.255609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.255774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.256338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.257104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.257469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.259037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.262138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d5c2-e0bd-40ef-ba01-cebf9eb57df7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.275741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 393/800] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.275741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.303888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.304489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.304799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.305072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.305738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.306039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.307432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608c4a-c6c6-4a76-b098-898ad53b9fc3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.320724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 408/801] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.320724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.320724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.320724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.337614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:08.338793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:08.381131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.387610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec01a9-ea26-41dc-9969-21158521faa1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.408837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 409/802] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:08.409975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.435320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.436366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.436850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.437293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.445505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.447425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:08.461930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.462974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:08.463870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.466242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 394/803] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.467373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.523118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.546670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b754-b17d-4c5a-8b2b-528794876d0a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.581468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5190be2-e413-4aae-b237-9ceea658e2ef None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.583812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.584622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.585718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.585718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.592973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.594542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:08.607106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.608085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:08.609074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:08.612929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 410/804] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.613860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.623143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.624121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.624601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.625091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.638559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.640333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:08.657111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.658111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:08.659010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:08.659010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:08.659010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.665575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 395/805] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.666757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.676705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.725134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b2131-c1f4-4b26-8f23-4d6373c8798c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.758056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.758652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.758926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.759191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.759875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.760175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.761627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.772560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3fd9-fbc9-43a0-83f1-8fada7c92adc None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.773811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 411/806] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.774547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.779417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.809066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.810677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.810965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.811223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.811953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.812255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.813709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3764e-c18e-4ea4-90cb-037a7d3b4b46 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.831204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 396/807] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.832392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43f1b-7f0d-47c9-8dc6-93469b54c03f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.832689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43f1b-7f0d-47c9-8dc6-93469b54c03f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.832971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43f1b-7f0d-47c9-8dc6-93469b54c03f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.834710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 397/808] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:08.835393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a43f1b-7f0d-47c9-8dc6-93469b54c03f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.879041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d3e8-192d-41cb-8d86-46473056384b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.897426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:08.914240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.914837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.915116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.915387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.916029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:08.916328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.917730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.928681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 412/809] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:08.929455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.937246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a43f1b-7f0d-47c9-8dc6-93469b54c03f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:08.970706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:08.971663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.971939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.972210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.972815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:08.975019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:08.983578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:08.988940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:08.990154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 398/810] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:08.991134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:08.994174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.033071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597012-3879-49f8-96d2-e68e034754c4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.068559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3864817-e555-4c21-8660-afd8516242af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.069237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864817-e555-4c21-8660-afd8516242af None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.069516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864817-e555-4c21-8660-afd8516242af None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.069783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864817-e555-4c21-8660-afd8516242af None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/285d5d20968a4dfe9c764fd09cc4ed4b/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.071689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3864817-e555-4c21-8660-afd8516242af None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=285d5d20968a4dfe9c764fd09cc4ed4b, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.073201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3864817-e555-4c21-8660-afd8516242af None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.087244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71333f81-f97a-4cbd-afd4-e7fa11b168bf None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.113400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.120998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d274-5307-4d35-859a-15f03574797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.121610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d274-5307-4d35-859a-15f03574797a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.121889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d274-5307-4d35-859a-15f03574797a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.122159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d274-5307-4d35-859a-15f03574797a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.132284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d274-5307-4d35-859a-15f03574797a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.133740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d274-5307-4d35-859a-15f03574797a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-f688d274-5307-4d35-859a-15f03574797a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:09.149023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.150174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:09.151248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:09.151248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:09.151248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:09.151248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 399/811] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.151510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.151744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.152014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.169076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:09.170253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.182097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 413/812] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:08 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/285d5d20968a4dfe9c764fd09cc4ed4b/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:09.182905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3864817-e555-4c21-8660-afd8516242af None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.247843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 400/813] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:09.249183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.316044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3864817-e555-4c21-8660-afd8516242af None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.359026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.372774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.373528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.373928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.374281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.383279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.384930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.396478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432820ae-7cf9-4304-b266-8740996a94e7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:09.397963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.399004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:09.399979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:09.400522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 414/814] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.404683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.417346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.452704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.453763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.454668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.455112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.456330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:09.458772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.459325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.465974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 401/815] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:09.467445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.523889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5dae0-51d5-4bff-b034-194aa6f902bb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.561596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.562198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.562473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.562737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.563509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:09.563807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.565318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.582777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 415/816] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:09.582777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.592741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f1333-bff0-400a-a8bc-d360c94ad6d9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.627419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.628116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.628462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.628905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.629699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:09.630195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.630957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.631730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.650219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 402/817] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:09.651061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.684240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.698849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a231-e13b-45ab-946e-6a695044f0d2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.735276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.735878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.736271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.736545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.737326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:09.737628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.739003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.754596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabba8-0036-477f-8539-2a75fdbee40d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.762950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 416/818] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:09.763960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.801596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.802795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.803070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.803503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] PATH_INFO: `/v3/services/network` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.804832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.806492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.816761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.817834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:38:09.818781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:09.821584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 403/819] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.821584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.874139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1157-346b-4c27-a05f-97c2eed6f714 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.884990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.912530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.913192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.913475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.913748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.921275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.922787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.929399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.935087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b49278-5214-4f4e-b465-4161703fefeb None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:09.936091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:09.937002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:09.937915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 417/820] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:09.938433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.977936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.978712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.979091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.979464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.051697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d849-1601-4742-96c9-b190eec75f5d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.057317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.058918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.088378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.089014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.089300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.089568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.090237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.091606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.154398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.160877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 404/821] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:10.161860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.214525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 418/822] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:10.215373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.280772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.298493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581002b-f729-4490-a076-7fc7866802b1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.356946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.357558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.357835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.358102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.358745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] RBAC: Adding query filter params (name=network) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.359048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.360429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.371008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 405/823] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.371983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.392422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e080-9fa0-494d-bbe7-28a881fc21d8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.434024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.434554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.434828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.435097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.435788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.436089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.437573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.444560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.453609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 419/824] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.459744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.498135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9beb-7c77-4817-98d6-aaa5b5d3e283 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.539093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.540165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.540650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.541167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.553271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.554852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.555889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:10.571932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:10.573001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:10.573916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:10.573916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:10.573916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:10.576508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0171f-9e7e-4332-aec6-2d21669602d9 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.577848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 406/825] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:10.578753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.617524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.618531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.619074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.619552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.620403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] RBAC: Adding query filter params (type=network) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.621062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.622639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.633778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 420/826] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.635269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.729341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4354-624a-4e32-9631-83e09e851bd9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.740846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.767473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.768572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.769510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.770127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/02588426fad84b17a81e738bafdac8d5/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.771696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b7ad-4253-498a-b5e9-0389d8951693 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:10.787653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=02588426fad84b17a81e738bafdac8d5, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.789552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.817357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:10.818013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:10.818340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:10.818559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:10.819207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:10.819509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:10.820910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:10.837976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 421/827] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:10.837976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.849962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:10.885574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 407/828] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:10 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/02588426fad84b17a81e738bafdac8d5/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:10.886869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:10.995106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf60c1-1dc3-43f5-a119-b2a7a2f41ea8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.054811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.055429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.055707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.055976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.056687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.058198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.085262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1741800-db36-4763-b9fa-7afbc3c3af54 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.122198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 422/829] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:11.139156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.139870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.140249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.140523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.149259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.150791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-f6b20832-96ab-4699-ab29-32cb00405a70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:11.164084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:11.165205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:11.166456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 408/830] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:11.173407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.221184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19acc-aa16-487d-9149-c4c9d691ab1c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.221615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19acc-aa16-487d-9149-c4c9d691ab1c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.221991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19acc-aa16-487d-9149-c4c9d691ab1c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.224348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 409/831] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:11.231423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.231809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.232179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.252975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:11.254157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.254353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:11.265688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.310015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610bcbf-3dce-47e1-a900-3e66080edd4b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.330511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 410/832] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:11.355025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.355647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.355947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.357678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.358396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.358706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.360175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.378098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 423/833] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:11.385739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.511251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96290-0e43-4f9f-81e8-2230dca8f16c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.561721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.562324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.562601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.562871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.563599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.563905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.565348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.574617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 411/834] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:11.625611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.740490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d032c1-c17a-4658-8c27-fd47d31cbb2b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.765546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.777742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.780954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.780954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.780954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.791106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:11.797590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:11.798649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:11.799533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 424/835] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:11.804974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:11.819477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.916211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202be89-e491-45d3-a0c1-990447f0ca50 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:11.950497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:11.951381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.951797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.952204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.953026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:11.953489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:11.954969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:11.964595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 412/836] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:11.969884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.079496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467b85-7651-4a7a-bf69-050634c91536 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.116167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.116830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.117146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.117384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.128306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.130359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:12.146164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:12.147131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:12.148734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:12.148734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:12.148734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:12.148734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 425/837] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:12.153516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.228011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.263040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b101-86e3-4929-85a9-c0239bf21db8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.299521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.300121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.300393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.300679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.301329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:12.301633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.303065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366707-db0e-44fb-979a-ba827223e443 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.315496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 413/838] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:12.321017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.358315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.366167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7274b-5090-44a5-81e4-15173d8e7843 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.366445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7274b-5090-44a5-81e4-15173d8e7843 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.366713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7274b-5090-44a5-81e4-15173d8e7843 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.368311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 414/839] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:12.373663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.374034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.374312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.394029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:12.397040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:12.434104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375682d3-5589-4bb9-89a4-04118056ce40 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.476082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 415/840] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:12.478743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.479375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.479653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.479922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.487606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.489089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:12.501149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:12.503445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:12.505568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 426/841] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:12.509733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.571129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.613318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ce8c3-76da-4073-b164-b2a226ba785a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.648818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.649421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.649695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.649965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.650689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:12.650988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.652404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.670574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 416/842] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:12.676118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.764303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.788770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.795102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461638-cc3d-41d1-9cd2-be108429c2aa None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.832055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.832987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.833399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.833679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.901032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95295c7-7c63-4d21-842d-f3d3e27cc4f3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.919664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.920358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.921851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.939852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.940538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.940858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.941155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.941838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.943928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:12.954454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:12.955652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:12.956487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 417/843] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:12.964706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.041581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.049043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 427/844] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:13.055076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.098344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c04e4-9c2a-415b-bdcb-9052dfd67955 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.134595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.135353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.135614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.135885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.136510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:13.136876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.138333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee522-060c-406f-83b6-3497eb589e1f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.143313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 418/845] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:13.144468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca18a-bd09-48fa-8395-8a3e71d9431e None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.144775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca18a-bd09-48fa-8395-8a3e71d9431e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.145047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca18a-bd09-48fa-8395-8a3e71d9431e None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.146948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 419/846] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:13.151601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca18a-bd09-48fa-8395-8a3e71d9431e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.166865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbcc0-676a-411e-bb4f-d45594614713 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.202496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.203384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.203823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.204247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.205604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.215411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.216911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-3bf42e60-6436-41c7-a022-df033770c3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:13.233307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:13.234276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 428/847] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.240991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.257707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:13.258901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:13.273148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca18a-bd09-48fa-8395-8a3e71d9431e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.308205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.312062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.312705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.313013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.313281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.313909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:13.314211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.315570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.320922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 420/848] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:13.325672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.345465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 429/849] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:13.465246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fddf-8985-4b83-8a7f-ec1180ed8480 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.477718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.502238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.502847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.503119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.503384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.504018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:13.504319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.506721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.518562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 421/850] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:13.524105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.632493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2836a4-7888-46df-8b4e-24938e5baa2c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.652379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.678622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.679259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.679539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.679807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.689282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.690999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:13.706306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:13.707240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:13.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 430/851] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:13.713809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.758573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.770829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538abec9-3b92-4997-8393-814bceee5cf9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.817201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.817921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.818479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.818825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.827748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b883-0964-4f11-b15c-d17cd1d7a6c8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:13.832627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1ff59181-5425-4c86-88f3-6c9f1cbbadb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:13.840206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:13.841355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:38:13.842736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:13.843879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:13.845240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3190b-64a4-4366-90ca-c8490adad83f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.845505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3190b-64a4-4366-90ca-c8490adad83f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.845773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3190b-64a4-4366-90ca-c8490adad83f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.851629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 423/853] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:13.851629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3190b-64a4-4366-90ca-c8490adad83f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:13.871642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:13.872230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:13.872504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:13.872811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:13.873498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:13.873797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:13.875227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580adca-d98b-45d4-a61f-9110f58c93af None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:13.884687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:13.964772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3190b-64a4-4366-90ca-c8490adad83f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.002305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.002908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.003184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.003449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.004109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.004414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.006033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.007148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 431/854] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.008222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.008508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.008871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.024494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 424/855] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:38:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:14.024494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.031324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:14.032499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:14.104853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 432/856] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:14.104853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.136945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.145973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.146258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917ccad-8e2b-45b8-b070-56af790496d1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.182335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.183045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.183444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.184020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.184581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=285d5d20968a4dfe9c764fd09cc4ed4b) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.185033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.186552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.197055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 425/857] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/role_assignments?user.id=285d5d20968a4dfe9c764fd09cc4ed4b&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.239660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c24b-df57-484f-8493-d7bb8f607e72 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.280935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.281823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.282246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.282655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.294811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.296551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:14.313696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.314895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:14.316018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:14.316018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:14.316018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:14.318438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 433/858] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:14.327110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.402590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.448161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32edd98-0640-418a-8a00-4a27e7290e26 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.487911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.488516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.488821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.489161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.489808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.490109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.491530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.498997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.506456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 426/859] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.511870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.527619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e50b2-0dd6-4c9b-8bcc-ddc3b949809a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.535692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.576920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.578587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.580233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.580730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.581494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.583658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.592999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.593994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:14.594902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:14.597702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 434/860] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:14.605308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.639350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec18cc-9247-4d56-a987-ecc325242c7c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.688407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.689193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.689482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.689748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.697712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.699163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:14.714184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:14.715281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:14.716718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:14.719833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 427/861] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:14.720693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.721216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f80e-3cbe-4328-b40e-381f0f310295 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.760517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.761502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.762010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.762475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.763310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.764298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.766332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.773772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 435/862] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.779443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.797124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.818063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.843084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318678-eb12-4c3c-bb2f-3b8ffd1e9a3e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.881121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.881831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.882191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.882531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.883325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.884873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.886417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.910568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 428/863] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:14.912100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.912712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604530d-e87d-45a5-8731-d3bdf2c4e60b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:14.957057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:14.957938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.958283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.958621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.959326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:14.959693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:14.961295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:14.973124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 436/864] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:15.032917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02249b-d848-4514-adf3-328069b5f18b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.073882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.074987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.075449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.075898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.079255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.150982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.152754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ec4a-05fc-4bb0-9319-ff98e7e771b0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.261586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 429/865] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:15.269591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.314130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852519-972d-4026-9e91-a0fd8c221f7f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.314457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852519-972d-4026-9e91-a0fd8c221f7f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.314661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852519-972d-4026-9e91-a0fd8c221f7f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.316285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 430/866] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:15.321722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.322115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.322483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.341840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:15.343051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:15.348718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.375699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.383013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc616e-bfa0-44ef-a11b-6ddfd9289b16 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.420012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.421104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.421613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.422091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.425030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 431/867] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:15.434043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.435743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:15.451432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:15.452390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:15.453319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:15.453319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:15.453319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:15.455362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 437/868] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:15.461364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.565886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbae958-9b9f-4234-b53c-05cdad95a32f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.601121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.601639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.601913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.602177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.602817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:15.603111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.604465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.617097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 432/869] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:15.622608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.705691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.736869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.738752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bd9b7-a67e-4c1e-bab9-d8b5aacbf789 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.769969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.783077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.784229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.784712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.785194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.793226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.795015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:15.811750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:15.812616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:15.813568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:15.816004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 438/870] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:15.823464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:15.839355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803e75-9830-48f6-9e99-8b4200d10a98 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.876569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.877184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.877577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.878106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.878761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.880969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.935690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a4c09-e855-4374-9b84-e857991245d6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.972465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.973975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.974867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.975495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.976126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:15.976579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.978174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824bd85-18db-4551-8535-ca4afc09f994 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.000466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 433/871] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:15 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:16.008515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 439/872] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.015399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.120386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.146333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f186-eec0-4e40-8b65-8d2a6369ffb9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.184847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.185448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.185723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.186045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.186828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=02588426fad84b17a81e738bafdac8d5) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:16.187129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.188546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44afb4-945b-4bdc-a9a2-e7f4910168fc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.195399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 434/873] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/role_assignments?user.id=02588426fad84b17a81e738bafdac8d5&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.213804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e2e6-9308-4393-ad85-52a286100b68 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.214105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e2e6-9308-4393-ad85-52a286100b68 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.214352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e2e6-9308-4393-ad85-52a286100b68 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.215803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 440/874] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:16.221975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.222543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.223019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.244412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:16.246003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:16.322068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 435/875] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:16.608939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e2e6-9308-4393-ad85-52a286100b68 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.659588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.719633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e2e6-9308-4393-ad85-52a286100b68 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.757228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.758116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.758542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.758966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.759689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.761229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:16.771923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:16.773193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:16.774235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:16.776739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 441/876] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:16.782794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.873724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:16.901718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbe0d0-1f5e-48df-8bf4-9ab35f0a4944 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:16.937577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:16.938551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.939028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.939549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.940400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:16.940924 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:16.942614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fed3e-fa6e-4ddc-8afe-1ce966f738d0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:16.947821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 436/877] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:16.953985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:16.954974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbf08-5c73-47f6-b326-e4bdfe1e4e0d None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.955256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbf08-5c73-47f6-b326-e4bdfe1e4e0d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.955525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbf08-5c73-47f6-b326-e4bdfe1e4e0d None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.957092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 437/878] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:16.962904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:16.963426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:16.963880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:16.982131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:16.983630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:17.065252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794793-b97b-42cb-9295-67ae61756b61 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:17.072123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 438/879] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:17.080191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:17.107837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:17.108795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:17.109249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:17.109720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:17.110677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:17.111149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:17.112746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84b33-f992-44f0-bace-6b350a5c58c4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:17.118689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 442/880] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:17.337960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:17.413129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:17.448951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdacc13-6199-49f2-b71c-858a9a0c7f83 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:17.485520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:17.486120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:17.486397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:17.486664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:17.487322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:17.488823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb943a-0c05-4cc3-ac19-1cba1168799f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:17.562932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 439/881] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:17 2022] POST /identity/v3/services => generated 269 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:18.017791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361343-1277-4fd5-8a2c-692d8d441166 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.018306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361343-1277-4fd5-8a2c-692d8d441166 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.018385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361343-1277-4fd5-8a2c-692d8d441166 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.020055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 443/882] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:18.026083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecd6c-d8d2-4754-8fa1-322dc1863754 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.026946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecd6c-d8d2-4754-8fa1-322dc1863754 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.027453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecd6c-d8d2-4754-8fa1-322dc1863754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.046968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-040ecd6c-d8d2-4754-8fa1-322dc1863754 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:18.048458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-040ecd6c-d8d2-4754-8fa1-322dc1863754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:18.128709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 440/883] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:18.384757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328a50-85d1-4a8f-a738-502ed2e2eaac None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.385427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328a50-85d1-4a8f-a738-502ed2e2eaac None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.385903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328a50-85d1-4a8f-a738-502ed2e2eaac None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.387645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 444/884] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:18.392953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.393244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.393514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.395961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328a50-85d1-4a8f-a738-502ed2e2eaac None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.413606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:18.414790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:18.490093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.504705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 441/885] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:18.511377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328a50-85d1-4a8f-a738-502ed2e2eaac None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.548581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.549483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.549913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.550426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.551027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.553034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:18.562440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:18.563463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:18.564327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 445/886] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:18.571782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.679465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb1e8e-d157-4833-846b-b4d47389008d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.717275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.717879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.718157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.718428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.719060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:18.719361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.720752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.726610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 442/887] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:18.733753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.774468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.791744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.856396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628807fe-4f64-4851-aceb-b58bb827b708 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.866440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:18.896243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.897424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.897912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.898481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.900260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:18.900791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:18.902462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:18.908607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 446/888] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:18.915028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:18.932468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299f31-6c73-4c49-a4c4-9fd5771b10fe None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:18.972008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:18.973844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:18.974324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:18.974958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:18.986934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:18.992895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:18.993890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:18.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:19.002203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 443/889] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:19.003376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.016617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.019490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac758f0e-d4ad-40ae-a89a-e2fb073a0917 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.056055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.056689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.056970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.057240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.058010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] RBAC: Adding query filter params (interface=public, service_id=c4ffea36a79f48e096bc18fa11ea65d0, region_id=RegionOne) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.058333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.059855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.072355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 447/890] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:18 2022] GET /identity/v3/endpoints?service_id=c4ffea36a79f48e096bc18fa11ea65d0&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:19.073427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.121827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798eaa-7e2e-457c-a44e-c8046c06e17d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.132696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.158001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.158610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.158888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.159156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.159827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.161510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.163328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617df1a3-81b6-4d3d-bff1-b260af909c8e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.172553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 444/891] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:19.173715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51265df-97ad-47e2-864a-dba6acafe693 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.173996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51265df-97ad-47e2-864a-dba6acafe693 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.174266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51265df-97ad-47e2-864a-dba6acafe693 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.175641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 445/892] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:19.181132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51265df-97ad-47e2-864a-dba6acafe693 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.195009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0d44-5bc5-4108-9da2-60b18043fd00 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.231311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.232272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.232272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.232499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.233117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.234483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745077-0e08-424b-9710-084411e0bd76 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.240760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 448/893] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:19.241775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.242058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.242325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.262809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:19.264023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:19.292632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.323852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51265df-97ad-47e2-864a-dba6acafe693 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.345440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 449/894] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:19.370517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.371141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.371415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.371844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.384279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.387171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-d36ecf85-ca4f-413f-b343-7909742df6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:19.403504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:19.404483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:19.406047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:19.406047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:19.406047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:19.406047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 446/895] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:19.411297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.522094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505796-ff02-4566-b402-3e372b963fd3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.558426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.559405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.559882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.560349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.561230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.561732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.563323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.569416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c4d28-2af1-4f39-a687-4896d40ea3fd None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.569699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c4d28-2af1-4f39-a687-4896d40ea3fd None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.569975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c4d28-2af1-4f39-a687-4896d40ea3fd None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.571543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 447/896] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:19.576450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.576765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.577041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.578432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 450/897] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:19.585012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.596280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:19.597500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:19.606558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.615715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.666506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 448/898] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:19.667657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.702750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a24f5-fa85-4866-a3e0-e34479d495b1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.741602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.742618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.743147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.743618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.752648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.755283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:19.768136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:19.769125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:19.770704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:19.773737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 451/899] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:19.779515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.786304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559776-3260-42e4-b1c5-786ff42f65ff None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.837487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.838627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.839622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.840244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.841277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.843542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.873434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.894738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c587e8-5c9d-48a7-8890-8f112480c0e4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:19.918325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 449/900] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:19 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:19.943296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:19.944421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:19.944969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:19.945457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:19.946594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:19.947199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:19.948967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:19.950773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:19.968065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:19.985421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 452/901] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:19.992260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.072151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd48548-44e2-4738-b61e-f5f618cfc74f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.111235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.111956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022a67-1b9d-4857-b4bc-233f724daf58 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.112592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.113047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.113474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.114630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.115982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:20.126701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:20.128049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:20.129041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 450/902] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:20.133611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.151894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.160341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.161906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.162270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.162997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.243223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.257137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.259236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.273717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5ea6-6103-4ac0-8675-c3882482de97 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.323910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.324628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.325039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.325644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.326160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.326555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.327996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.339049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 451/903] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:20.340055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.401788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 453/904] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:20.403472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.437945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.470060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4df158-6c51-4333-9caa-2d1538d90be5 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.510078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.510694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.511074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.511439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.512180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.512581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.514189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.519460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 452/905] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:20.521346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d893eb-c793-4dbf-aced-f4d18e17618b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.525021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.529613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.561323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.562178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.562611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.563060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.573754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.575436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:20.591021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:20.592208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:20.593317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:20.593317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:20.593317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:20.600563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 454/906] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:20.601630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.631157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424af0-d1e4-45d2-b4c5-262f707bb412 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.667637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.668234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.668509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.668841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.669545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] RBAC: Adding query filter params (interface=public, service_id=e60dfc6ffdc44d638fc1e4fdd7463b70, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.669827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.671187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.682700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 453/907] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/endpoints?service_id=e60dfc6ffdc44d638fc1e4fdd7463b70&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:20.683154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.698438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.716858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad851-77f8-432c-b863-dafde5f01ab6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.751899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:20.756191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.757024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.757456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.757877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.758669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:20.759140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.760679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.778696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 455/908] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:20.779785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:20.788881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd6e-22e6-4479-9578-66d4f4ec69cf None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.835785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.836323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.836567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.836881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.837481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.838842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.852840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 454/909] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:38:20.897457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e999b-0f93-4c53-9eac-4d0914e121a2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:20.937636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:20.938564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:20.938995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:20.939416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:20.948421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:20.950169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:20.963035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:20.964195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:20.965429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:20.967548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 456/910] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:20.975885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:21.087443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae52b-31dd-48cc-92bc-91ef3f0b8af5 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:21.126885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:21.132920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:21.133531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.133810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.134083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.134774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:21.135080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:21.136508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9957-c9a6-4546-adf3-de93356202a4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:21.149432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 455/911] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:21.155818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:21.159761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:21.251763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18702-1b3e-4dd3-998e-50d065fcdfa6 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.252034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18702-1b3e-4dd3-998e-50d065fcdfa6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.252338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18702-1b3e-4dd3-998e-50d065fcdfa6 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.254549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 456/912] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:21.260021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.260300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.260573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.268434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1940-631a-4fa1-b102-c25944888e09 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:21.281409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:21.282979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:21.311551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:21.312232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.312521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.312820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.313556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] RBAC: Adding query filter params (role.id=b10a8aaa59844db9808b917c312357aa, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=02588426fad84b17a81e738bafdac8d5) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:21.313868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:21.315309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:21.321955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 457/913] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:21 2022] GET /identity/v3/role_assignments?user.id=02588426fad84b17a81e738bafdac8d5&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=b10a8aaa59844db9808b917c312357aa => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:21.361122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 457/914] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:21.630871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:21.701217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:21.736054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56dadc-91c1-4f32-b5e8-0dfe03273a54 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:21.771372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:21.772002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.772282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.772554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.773172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:21.774540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:21.783992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:21.785060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:21.786606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 458/915] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:21.793979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:21.901620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe787-abf6-46f8-ab38-95c83c11d5bf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:21.926293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:21.938200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:21.938802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.939108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.939333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.940021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:21.940325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:21.942383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1992d19-f13a-4252-9dc5-d786752fd070 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:21.948001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 458/916] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:21.953907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:21.956539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4645-cc04-452f-8391-26393fabc3e9 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.957058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4645-cc04-452f-8391-26393fabc3e9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.957141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed4645-cc04-452f-8391-26393fabc3e9 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.958895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 459/917] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:21.964433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:21.964748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:21.965022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:21.985538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:21.986717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:22.076764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 460/918] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:22.088335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53628f9-3fc3-4835-a586-fddda4239722 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.123870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.124480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.124787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.125061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.125692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:22.125993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.127363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.132830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.133070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 459/919] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Aug 30 14:38:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:22.141922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.248154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc295e7-8eb3-4ed1-9ce1-6be679aefa75 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.265010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.283575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.285687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.285687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.285687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.285687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.286874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.347494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.369160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 461/920] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:22.465420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee454c6-96e1-417b-8294-44ee1db9ae1a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.510979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.511529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.511818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.512091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.512703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.514137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:22.523634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:22.524804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:22.525663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:22.528870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 460/921] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:22.534754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.646856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59537a5a-ccb8-4663-9c13-022f6815731b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.687123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.687732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.688011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.688281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.688949 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:22.689252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.690623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.696458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 462/922] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:22.702017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.763135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.809694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79fc6-aef8-4859-aced-d472515891fc None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:22.848584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:22.849119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.849403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.849678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.850415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:22.850722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:22.852160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d458-828c-44a4-a003-f2fa0d074a9b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:22.857611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 461/923] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:22.868570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:22.907139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:22.930280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b9-e7d7-45a9-9bc6-4e91c00b20d0 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.930562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b9-e7d7-45a9-9bc6-4e91c00b20d0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.930839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd40b9-e7d7-45a9-9bc6-4e91c00b20d0 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.933754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 462/924] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:22.938474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:22.938754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:22.939028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:22.957966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:22.959173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:22.983325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d73-8aa2-4431-965d-b57c1b5b53f6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.021260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.021807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.022084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.022350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.023095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] RBAC: Adding query filter params (interface=public, service_id=279732c60ad146c9a5175ab557397913, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:23.023399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:23.024838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:23.030769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 463/925] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:22 2022] GET /identity/v3/endpoints?service_id=279732c60ad146c9a5175ab557397913&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:23.037377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.039942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 463/926] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:23.146942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b32b-b88b-4562-ae7b-0a78356e730d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.149185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:23.183657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.184255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.184528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.184823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.185418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:23.186770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b67db-2d0c-4020-9ef4-36950482dca1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:23.199754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 464/927] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:23.324654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.338278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992a13-c546-4c3c-8e4f-0a3cd337d988 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.338581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992a13-c546-4c3c-8e4f-0a3cd337d988 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.338826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992a13-c546-4c3c-8e4f-0a3cd337d988 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.340287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 465/928] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:23.345125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.345405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.345731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.366246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:23.368704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:23.398452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:23.455212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 466/929] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:23.468148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d948fa-7c8c-4046-8161-4762f4197ee8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.503100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.503727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.504000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.504837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.505416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:23.506855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:23.515783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:23.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:23.517708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 464/930] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:23.523568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.628160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:23.635099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd768f-1ff3-4ef8-910b-a3e04850cced None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.671332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.671931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.672202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.672470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.673132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:23.673433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:23.674876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:23.680653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 467/931] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:23.686217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.751439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.812190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f26-fb40-4d18-8c45-53bf3c76f82a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.828315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:23.851182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.851907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.852281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.852777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.853569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:23.854149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:23.855727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:23.861281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4586-a996-42be-8433-d2c7c4800f87 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:23.866592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 465/932] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:23.867699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.900998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:23.901910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:23.902413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:23.903150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:23.915355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:23.920756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:23.921676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:23.922525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:23.930274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 468/933] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:23.931505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:23.952607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:23.981461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bcb43-e5f4-4e74-8517-938d8712695e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.018706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.019144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.019425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.019775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.020672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.022073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.044255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6547-2f43-4129-be60-246cf7ba71f0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.079367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.079957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.080234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.080501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.081194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:24.081504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.083596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.092129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 469/934] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:24.097525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.107650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 466/935] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:24.201825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:24.223900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dbedf-3194-4b64-813a-271d6f934154 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.271588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.272208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.272479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.272768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.283763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.285908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1f93f65c-971d-4ca1-87ea-5601bbd04001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:24.302210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:24.303218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:24.304124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:24.304124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:24.304124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:24.304124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 470/936] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:24.311005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.351465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:24.424322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c7fd-3508-4171-8e89-5e7c2502cecb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.450089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84016e-fd56-46fd-a2d6-db817d5e6de6 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.450366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84016e-fd56-46fd-a2d6-db817d5e6de6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.450635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84016e-fd56-46fd-a2d6-db817d5e6de6 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.452001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 471/937] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:24.456954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.457907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.458269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.465856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.466460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.466734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.467001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.467638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:24.467938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.469387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.479372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:24.480868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:24.486949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 467/938] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:24.488170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.573261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 472/939] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:24.592640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:24.600508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff94d4-bf99-4c49-9d7c-c9b9c2371e6f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.637224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.637853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.638191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.638465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.646719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.648269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:24.661749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:24.662728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:24.663680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 468/940] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:24.669685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.730518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:24.784978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c631031-57f7-4325-9307-55f5653bbd17 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:24.833419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:24.834036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:24.834312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:24.834576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:24.835315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:24.835614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:24.837063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:24.855635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 473/941] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:24.861270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.901950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:24.965853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553ba2-d67c-4ea9-9648-807d886b434c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.007198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.007832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.008110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.008388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.015725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335cba1-b283-42ec-9246-a7fc0aa13367 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.019502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.021123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.034142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:25.038030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:25.039499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:25.040408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:25.040408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:25.040408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:25.043123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 469/942] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:25.044029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.054081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.062448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.063349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.063819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.064322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.065275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.067369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.070394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING keystone.server.flask.common [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 14:38:25.126879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.sql.core [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:38:25.126879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:38:25.126879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [parameters: {'id': '5ba97023e26e485a964fa6208f3e83d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:38:25.126879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba97023e26e485a964fa6208f3e83d1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba97023e26e485a964fa6208f3e83d1. Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:38:25.138246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result.read() Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 14:38:25.139111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application yield resource Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise self.value Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application session.commit() Aug 30 14:38:25.140189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:38:25.141152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:38:25.142087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application result.read() Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:38:25.145109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [parameters: {'id': '5ba97023e26e485a964fa6208f3e83d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.148359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:25.150734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba97023e26e485a964fa6208f3e83d1. Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 474/943] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Aug 30 14:38:24 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:25.153688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.167941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beefa6-66f0-472f-a2e4-25bc31c9c20d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.216065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.216708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.216985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.217253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.217919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:25.218464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.220142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3a8e-a1b8-4212-ad80-362817c1ff27 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.236429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 470/944] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.236429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d11c4-5fd1-409d-ac88-89ceeab5f19a None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.236429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d11c4-5fd1-409d-ac88-89ceeab5f19a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.236429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d11c4-5fd1-409d-ac88-89ceeab5f19a None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.236429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 471/945] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:25.241532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d11c4-5fd1-409d-ac88-89ceeab5f19a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.268037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f4f0d-a413-412f-bd7b-b33508dd92e8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.306919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.307540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.307824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.308097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.313697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.315502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.317289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-30d92b27-7d41-430f-be22-6d6e248435e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:25.336557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:25.337689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.339503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 475/946] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:25.340086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.340342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.340619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.357444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d11c4-5fd1-409d-ac88-89ceeab5f19a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.360882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:25.362456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:25.391916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.400625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.402375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.402660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.403196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.413909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.415427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:25.427618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:25.429002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 472/947] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:25.430477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.444052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 476/948] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:25.444717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.554459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64781c6b-c31f-4e00-9f68-a7db4b2e60a4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.563757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326137ff-84bc-4492-b17b-6109a6359114 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.581865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.591702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.592749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.592749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.593004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.593598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:25.593903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.595663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.613278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.614233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.614713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.615193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 473/949] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.615463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.616221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:25.616533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.618014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.635167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 477/950] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:25.641279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.717360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.757950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.781854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649e6e-6f44-4096-bbfe-15654f4aea82 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.833852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.834923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.835403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.835944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/02588426fad84b17a81e738bafdac8d5/roles/b10a8aaa59844db9808b917c312357aa` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.838451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=02588426fad84b17a81e738bafdac8d5, role_id=b10a8aaa59844db9808b917c312357aa)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.840217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.858338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80313-d058-42da-a6cf-beb1dc3d991c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:25.896591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:25.897300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:25.897577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:25.897941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:25.898525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:25.899954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:25.911392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:25.912567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:25.913987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 478/951] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:25.918690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:25.933413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 474/952] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:25 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/02588426fad84b17a81e738bafdac8d5/roles/b10a8aaa59844db9808b917c312357aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:26.026573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:26.043973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3166-28af-4251-acf7-5f490aafc06c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:26.094885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:26.095836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.096326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.096912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.098428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:26.098937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:26.100522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d945-a04c-467a-b9cf-7a67f620c4ce None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:26.106793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 479/953] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:26.112230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:26.164632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:26.219137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b2558-aab7-4437-8671-bd5e569af18a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:26.241981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1013-a1e3-4791-92d0-c42590e856ed None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.242289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1013-a1e3-4791-92d0-c42590e856ed None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.242522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1013-a1e3-4791-92d0-c42590e856ed None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.245087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 480/954] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:26.249023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.249305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.249575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.256966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf469f18-9772-440c-8168-729770865cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:26.257571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf469f18-9772-440c-8168-729770865cdd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.257845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf469f18-9772-440c-8168-729770865cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.258110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf469f18-9772-440c-8168-729770865cdd None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.258743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf469f18-9772-440c-8168-729770865cdd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:26.259037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf469f18-9772-440c-8168-729770865cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:26.260398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf469f18-9772-440c-8168-729770865cdd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:26.265785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 475/955] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:26.271820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf469f18-9772-440c-8168-729770865cdd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:26.275554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:26.276866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:26.366128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 481/956] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:26.423468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf469f18-9772-440c-8168-729770865cdd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:26.445005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:26.544920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:26.545534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.545813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.546200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.546933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:26.548315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:26.659964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:26.673814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 476/957] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:26.748076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:26.768779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc076d6-831e-4970-9832-92e9e6eccf50 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:26.825257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:26.825565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:26.825984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:26.826317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:26.826983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:26.828452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:26.841269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:26.842439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:26.843291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:26.850520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 482/958] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:26.852002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:26.983463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff71a34-bdd1-4ade-9bba-cd64da3bcf00 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:27.018458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:27.019069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.019347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.019813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:27.020725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:27.021040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:27.022418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8c405-c565-46b6-9370-1246e5eab959 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:27.032225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 477/959] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:27.033558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:27.139016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220dd5-b66b-467e-981c-8214bcf0bed3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:27.181364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:27.181984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.182260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.182529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:27.183168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:27.183467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:27.184870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91814b8-1036-4a55-acd9-9b133cd19485 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:27.196760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 483/960] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:27.800978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f978bf-ad9d-4af8-ac7e-c113bdab36e9 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.800978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f978bf-ad9d-4af8-ac7e-c113bdab36e9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.800978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f978bf-ad9d-4af8-ac7e-c113bdab36e9 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:27.802459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 478/961] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:27.809942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968507-a212-4af1-b4b6-67bcbf1e781d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:27.809942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968507-a212-4af1-b4b6-67bcbf1e781d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:27.809942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968507-a212-4af1-b4b6-67bcbf1e781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:27.815417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:27.827706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-5f968507-a212-4af1-b4b6-67bcbf1e781d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:27.831277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5f968507-a212-4af1-b4b6-67bcbf1e781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:27.901094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 484/962] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:28.038231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c516-4216-4bde-ad90-2ee19f210513 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.038586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c516-4216-4bde-ad90-2ee19f210513 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.038756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c516-4216-4bde-ad90-2ee19f210513 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.040335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 479/963] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:28.045542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.045829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.046099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.064277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:28.065396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:28.136890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 485/964] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:28.170098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c516-4216-4bde-ad90-2ee19f210513 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.208896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.287208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c516-4216-4bde-ad90-2ee19f210513 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.325388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.325907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.326188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.326462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.327102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.328607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.331143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING keystone.server.flask.common [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 14:38:28.375010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.sql.core [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:38:28.375010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:38:28.375010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [parameters: {'user_id': '0043f73085f246fda2709bd97c22fc5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:38:28.375010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93237) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application result.read() Aug 30 14:38:28.392642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:38:28.395022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application yield resource Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise self.value Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application session.commit() Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:38:28.397419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:38:28.399798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:38:28.401969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application result.read() Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:38:28.403697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [parameters: {'user_id': '0043f73085f246fda2709bd97c22fc5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:28.405597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 14:38:28.406446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.407439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 480/965] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Aug 30 14:38:28 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:28.407881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.418238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.507946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.542211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.552285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4e68-a9e6-4989-87bf-57dd1fa01ee6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.556314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9a73-f4e8-4006-8392-ffaf3e37cb5b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.592018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.592018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.592018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.592018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.600091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.601573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.603893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.605404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.605895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.606392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:28.615237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:28.616233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:28.617808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 486/966] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:28.622451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:28.627254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:28.628209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:28.629373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:28.631198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.631867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 481/967] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:28.635554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.754965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8646e6-d787-4b4b-87d6-41de07ec3cda None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.776933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.777490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45d286-d97e-4313-a1db-b63855982234 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:28.789712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.791883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.791883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.791883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.791883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:28.791883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.793437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e51f9-100b-406f-83f3-6571986127eb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.820141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:28.821460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.821959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.822444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.823315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:28.823932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:28.825750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:28.832644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 487/968] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:28.834075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a33-9fd0-4afd-85d5-04d06e978f54 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.834358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a33-9fd0-4afd-85d5-04d06e978f54 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.834631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a33-9fd0-4afd-85d5-04d06e978f54 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.836198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 488/969] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:28.844818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:28.844818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:28.844818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:28.845720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 482/970] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:28.847495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:28.867180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:28.868648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:28.868826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:28.964263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 489/971] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:28.984009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60845e-7e1e-48ef-bb4c-faf971127648 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.021567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.022546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.023049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.023514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.035059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.036804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-dce7deb0-3ad7-45eb-82a6-513d418636a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:29.052228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:29.053375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:29.054503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:29.054503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:29.054503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:29.058789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 483/972] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:29.065471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.166482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80cdb7-7ad3-48a5-be2c-5dda51c9888b None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.166683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80cdb7-7ad3-48a5-be2c-5dda51c9888b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.166947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80cdb7-7ad3-48a5-be2c-5dda51c9888b None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.168408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 484/973] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:29.173011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.173297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.173568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.173768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592856c-67aa-4d61-b9ec-dd163e541abc None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.188615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.195180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:29.196822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:29.213071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.213681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.213959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.214233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.214872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:29.215228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.216641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.229427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 490/974] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:29.232560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.265298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.273618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 485/975] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:29.275630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.338317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6ca2-8316-415c-b11d-e90c80598331 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.374168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fced16-5055-4f7d-b7ab-319af68ad529 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.374416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.374953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.375260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.375581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.376153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.377698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:29.387803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:29.388918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:29.389922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 491/976] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:29.396308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.415426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.416051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.416328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.416653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.423701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.425178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.432090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:29.437268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:29.442951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:29.443921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 486/977] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:29.444548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.501217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.505902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4033-6f5b-4630-9566-3dfe6d006f03 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.544155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.545038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.545312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.545579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.546198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:29.546494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.547769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961683-d0c4-47a9-9591-3eae96e94d85 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.547879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.552630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 492/978] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:29.553454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.585120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.585718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.585997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.586271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.586991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:29.587294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.588740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.606022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 487/979] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:29.609526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.650577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.653939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99853e-5656-41ec-bc76-849dbdb8965b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.689153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.689672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.690056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.690213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.690855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.692343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.709248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa809f-9823-4377-ad5a-f715ed032ff8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.723435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.742513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.743099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.743376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.743645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.744272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:29.744568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.745959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.750593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 488/980] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:29.751989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.778083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 493/981] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:29 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:29.778873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.882681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da095bc-ab94-4b41-bf3f-bb015ede6e1a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.911147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2e8a-9a90-4a88-83a4-073f302221f8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:29.926080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.926700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.926982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.927253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.950065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:29.950967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:29.950967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:29.951159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:29.951838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] RBAC: Adding query filter params (interface=admin, service_id=279732c60ad146c9a5175ab557397913, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:29.952146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:29.953558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:29.959214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 494/982] 10.222.0.13 () {56 vars in 1249 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/endpoints?service_id=279732c60ad146c9a5175ab557397913&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:29.964632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:29.978946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:29.991052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:30.001849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.003311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.073901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec92d0-b687-4716-9c37-74de05f9bf92 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.112461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.113245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.113529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.113809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.114410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.115775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.117160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 489/983] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:30.122620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:30.126644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 495/984] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:29 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:30.216423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:30.240630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406944e4-173f-4fff-86da-b43f7f161b73 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.281759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.282374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.282648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.282916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.293569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.295130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:30.311584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:30.312637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:30.313889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:30.313889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:30.313889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:30.313889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 490/985] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:30.320277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:30.407072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:30.423242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0354c-efb4-48af-9c8e-a44908aa2ea7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.458983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.459681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.460028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.460366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.461181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:30.461551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.463053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.479218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 496/986] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:30.480726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:30.581247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fbdd-ee63-4efd-9877-e68928702800 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.611536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:30.618401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.619147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.619523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.619860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.626569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.628097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:30.639958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:30.641140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:30.642284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:30.642950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 491/987] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:30.649205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:30.752371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1886d2-0625-40f4-b021-56b9b979a642 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.787175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.787922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.788305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.788685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.789485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:30.789890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.791433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92b3c-3eec-4b1a-9513-3f584f1d0e4d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.810883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 497/988] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:30.811831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:30.919697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc4ac-96ac-4b33-94db-fb80d0f91ffd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:30.953054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:30.953655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:30.953977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:30.954255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:30.954977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] RBAC: Adding query filter params (role.id=b10a8aaa59844db9808b917c312357aa, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=02588426fad84b17a81e738bafdac8d5) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:30.955282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:30.956801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ffc65-efd8-4de8-b0a6-73ca9f00c400 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:30.968688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 492/989] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:30 2022] GET /identity/v3/role_assignments?user.id=02588426fad84b17a81e738bafdac8d5&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=b10a8aaa59844db9808b917c312357aa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:31.738706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6189-2807-447b-bdeb-3aadbf1033ed None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.739284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6189-2807-447b-bdeb-3aadbf1033ed None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.739284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff6189-2807-447b-bdeb-3aadbf1033ed None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.740905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 498/990] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:31.746171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48e7a-5701-469b-bbda-c2aa4907338d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:31.746462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48e7a-5701-469b-bbda-c2aa4907338d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:31.746733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48e7a-5701-469b-bbda-c2aa4907338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:31.766557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3bb48e7a-5701-469b-bbda-c2aa4907338d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:31.767731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3bb48e7a-5701-469b-bbda-c2aa4907338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:31.826866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:31.843997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 493/991] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:32.070007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49814ef-7a46-4ac9-ad51-c2381833aa98 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.070206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49814ef-7a46-4ac9-ad51-c2381833aa98 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.070486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49814ef-7a46-4ac9-ad51-c2381833aa98 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.071958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 499/992] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:32.077083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.077522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.077721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.096309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:32.097798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:32.116952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49814ef-7a46-4ac9-ad51-c2381833aa98 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.120827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.172206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 494/993] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:32.229520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49814ef-7a46-4ac9-ad51-c2381833aa98 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.264042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.264736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.265013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.265286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.265858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.267204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:32.276349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:32.277379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:32.281771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 500/994] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:32.284107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.384081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff5985-0c50-4b2b-b926-b75197695695 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.398789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.419405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.420011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.420288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.420557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.421224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.421527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.422899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.432583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 495/995] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:32.434352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.442006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.506390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.543025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca909-d4b6-44ab-8a08-96b546295a2a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.551104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328c1b-a0a3-4b11-85f4-b71e421520fb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.580227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.580959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.581237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.582052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.582816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.583121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.584494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.590559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.591188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.591468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.591737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.592271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 501/996] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:32.592379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.593857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.598459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:32.604334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:32.605347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:38:32.606190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:32.610475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 496/997] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:32.611130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.662662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.711043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f942a-5b25-46c3-a3bb-81d8f8ff5750 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.719353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f196-e114-47de-89da-0185b1c64024 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.754071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.754776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.755054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.755323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.755961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.756264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.757671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.762663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 497/998] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:32.768289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.771446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.776928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.777794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.778078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.778412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.779120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] RBAC: Adding query filter params (interface=public, service_id=c81c1120f65f446e9bd124b6034de97d, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.779429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.780822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.786393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 502/999] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/endpoints?service_id=c81c1120f65f446e9bd124b6034de97d&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:32.792105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.893592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a393-7e52-4382-8544-3c82a9bf31c0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.902278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:32.906823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23dd2e-4cb4-4e4d-aff6-9b5d0f271a7e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:32.929277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.929816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.930092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.930357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.930980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:32.931280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.932641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906294d-1cff-400f-ad25-596c553b5ce7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.937947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 498/1000] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:32.939475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cc4c-be48-4dab-89ae-f84e5deaa37e None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.939766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cc4c-be48-4dab-89ae-f84e5deaa37e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.940043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54cc4c-be48-4dab-89ae-f84e5deaa37e None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.940332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:32.941513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.941872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.942266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 499/1001] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:32.943699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54cc4c-be48-4dab-89ae-f84e5deaa37e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:32.944895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.945542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:32.947008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5dd5-8560-4185-9939-be22ca898b5b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:32.957623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 503/1002] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:32 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:32.957623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:32.957623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:32.957623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:32.982129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:32.983360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:33.053530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:33.065534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54cc4c-be48-4dab-89ae-f84e5deaa37e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:33.071768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 504/1003] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:33.104486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:33.105132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.105411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.105678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:33.106370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:33.107740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:33.178910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 500/1004] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:33.348173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:33.458750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b8188-d82f-4a44-985f-3b1b498d4ce3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:33.520342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:33.520996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.521272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.521539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] PATH_INFO: `/v3/services/image` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:33.522111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:33.525804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:33.539962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:33.541053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:33.541908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 505/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:33 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:33.548684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:33.589612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:33.670152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73412f-14e5-4709-8d09-9b7378d752be None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:33.705848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:33.706477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.706761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.707033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:33.707779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] RBAC: Adding query filter params (name=image) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:33.708079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:33.709503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a65d3-3e9d-439e-879c-113859716dd3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:33.714982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 501/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:33.720408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:33.779908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:33.844715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6caf9c-a56a-4849-a0ca-85df603ad191 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:33.889292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:33.890276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:33.890562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:33.890836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:33.891472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:33.891776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:33.893173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387446a-f157-452b-9098-7313dd4976e5 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:33.904910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 506/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:35.064181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e109a5-8d2e-45cc-9144-6b15bd4c02b6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.064698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e109a5-8d2e-45cc-9144-6b15bd4c02b6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.064698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e109a5-8d2e-45cc-9144-6b15bd4c02b6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.066113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 502/1008] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:35.071450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.071861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.072031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.090558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:35.091752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.145861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b5b3-3c8e-467a-8e99-884f04ef82b8 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.146142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b5b3-3c8e-467a-8e99-884f04ef82b8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.146420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4b5b3-3c8e-467a-8e99-884f04ef82b8 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.147760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 503/1009] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:35.153142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.153429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.153709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.165717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 507/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:35.172257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:35.173467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.241185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 504/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:35.436320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.483174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.509098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.533518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.540709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58adcf-3e9f-4611-ba3b-4cd19cca2718 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.576569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.577218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.577495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.577769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.578348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.579702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:35.589758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:35.590783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:35.591650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 508/1012] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:35.596476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.615331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac93b0-2c58-41c6-8804-fda650d04124 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.650056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.650683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.650963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.651230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.652337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.654060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.655777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 505/1013] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:35.661364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.700379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6615-cd94-41d1-961b-56a384c9dfe7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.710953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.737227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.738359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.738656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.738885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.739515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:35.739932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.741449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.746727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 509/1014] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:35.751833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.759621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.770971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ba19-4b91-46df-8d9d-b5196aaf6db6 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.814939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.815553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.815891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.816319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.817012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.818459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78bfd0-4d15-4086-8a46-d168b5655cac None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.855833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358189-24cb-439a-a0d8-7817115e5462 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.889811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.890428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.890697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.890960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.891582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:35.891880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.893290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.898232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 510/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Aug 30 14:38:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:35.903997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.911691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 506/1016] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:35.945185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.959811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b35ca-04ac-4bfd-a01b-4610b62b06dd None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.959994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b35ca-04ac-4bfd-a01b-4610b62b06dd None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.960259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b35ca-04ac-4bfd-a01b-4610b62b06dd None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.961655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 507/1017] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:35.967385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.967690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.967929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.988734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:35.989976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:36.024941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee302f-838f-447f-97f8-1760f4369b17 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:36.066949 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:36.067556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:36.068388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:36.068388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:36.069454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:36.069569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 508/1018] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:36.070146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940cfce-2e10-4c05-86eb-1321fe0b68b3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:36.150376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 511/1019] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:36.340324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:36.421796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:36.447005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684620bc-5e37-4601-b6ee-8dce8c207904 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:36.488368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:36.489001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:36.489281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:36.489550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:36.490200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:36.491569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b3d1-2e35-474e-a6f5-803720e84186 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:36.567228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 509/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:38:36 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:37.889486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f681-c4df-427f-9571-a2b6433e5af6 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:37.890001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f681-c4df-427f-9571-a2b6433e5af6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:37.890082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f681-c4df-427f-9571-a2b6433e5af6 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:37.891403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 512/1021] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:37.897263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609e0e-d9ba-492f-82b8-a1f73c78ae02 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:37.897711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609e0e-d9ba-492f-82b8-a1f73c78ae02 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:37.897895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609e0e-d9ba-492f-82b8-a1f73c78ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:37.916971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-81609e0e-d9ba-492f-82b8-a1f73c78ae02 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:37.918168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-81609e0e-d9ba-492f-82b8-a1f73c78ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:37.995383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 510/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:38.174034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7e9a-76d3-4af4-9429-b14dbd44dc71 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.174352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7e9a-76d3-4af4-9429-b14dbd44dc71 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.174535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e7e9a-76d3-4af4-9429-b14dbd44dc71 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.176571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 513/1023] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:38.181704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.181995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.182271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.201064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:38.202237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:38.254599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:38.269458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e7e9a-76d3-4af4-9429-b14dbd44dc71 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.272728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 511/1024] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:38.365152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:38.374931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e7e9a-76d3-4af4-9429-b14dbd44dc71 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:38.410613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:38.411232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.411509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.411781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.412917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:38.414415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b893c69-76d3-4c4c-ab21-4b7cd71d62d3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:38.416698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 514/1025] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:38.421710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.489621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f59b8-d08f-4014-b731-ddc074d637f7 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.489913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f59b8-d08f-4014-b731-ddc074d637f7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.490173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f59b8-d08f-4014-b731-ddc074d637f7 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.491636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 515/1026] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:38.496156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.496435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.496731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.520314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:38.521519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:38.531549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168e74-3ed8-4aca-96d7-1a759b36d5ad None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:38.568411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:38.569040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.569324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.569593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.570243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:38.571684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:38.589819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 516/1027] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:38.590640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.668717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 512/1028] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:38 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:38.692259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:38.702807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41fbd-ae10-4d3a-808d-008193e9acaf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:38.741558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:38.742113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.742480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.742699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.755042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:38.759903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:38.760937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:38.762377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 517/1029] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:38.770954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.836652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:38.865160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.898174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dff65a-7e01-4708-bae7-b9eee06c264e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:38.935303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:38.936246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.936770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.937211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.938187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:38.938700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:38.940239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:38.950633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 513/1030] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:38.956437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.983974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a130e-4f7a-4445-82c2-681406a77b37 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.020431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.021022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.021274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.027831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] PATH_INFO: `/v3/services/image` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.027831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.027831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:39.032515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:39.033581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:39.035014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:39.039127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 518/1031] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:39.040263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.111732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.133016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49290f7-4ee0-4a9b-8567-a5ecc6f0a21f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.136255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.172992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.173624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.173904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.174332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.189362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.192207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:39.209332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:39.210519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:39.211430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:39.211430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:39.211430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:39.211430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 514/1032] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:39.216069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.216996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca46f5-c4f9-44fc-8ff0-7f7f8e430f83 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.257932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.258543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.258827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.259094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.259727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] RBAC: Adding query filter params (name=image) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.260026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.261436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.266383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 519/1033] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:39.276770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.326643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53501-dda4-4073-9f7c-bd4c2549d67a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.357403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.363759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.364369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.364646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.364942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.365589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.365892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.367267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.379648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 515/1034] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:39.380379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7ab8-c977-41b5-87b6-205c346af767 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.385186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.405286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.417258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.417864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.418138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.418405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.419032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] RBAC: Adding query filter params (type=image) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.419585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.420692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.426321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 520/1035] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:39.431930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.493805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ca5f-b482-4969-b65e-3c08c08936f2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.529549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.530094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.530381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.530652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.538678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.539953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a86c1-f066-4a68-95bc-c5bcf2304d44 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.540145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:39.552419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:39.553568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:39.554892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 516/1036] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:39.559095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.577744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.578423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.578706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.578962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.579656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] RBAC: Adding query filter params (interface=public, service_id=4109e2634cdb402193011d708b2a5faf, region_id=RegionOne) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.579960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.581985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.587206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 521/1037] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/endpoints?service_id=4109e2634cdb402193011d708b2a5faf&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:39.592478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.602191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.640261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.663786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fc8d-22b3-413b-982d-d7caefcc5156 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.699220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647f0b-764a-4699-ae9c-b47e5b20002f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.700226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.700867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.701307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.701589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.703144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:39.703458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.704925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.731095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 517/1038] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:39.734599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.735195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.735555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.735826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.736417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.736637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:39.738242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:39.756691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 522/1039] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:38:39.868958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f442f-a17d-48bb-aa1b-6b8eca594f48 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:39.907399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:39.908045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:39.908318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:39.908589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:39.911898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:39.979441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:39.980924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.084046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 518/1040] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:40.085813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.157514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.189668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135e43-ad86-4358-ae1e-110ab875207b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.224954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.225576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.225851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.226116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.236863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.238986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:40.253589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:40.254612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:40.255572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:40.255572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:40.255572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:40.255572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 523/1041] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:40.261665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.295262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.362118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ec808-133a-4ef4-958e-03de07049d53 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.396847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.397452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.397731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.398000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.398641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:40.398939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.400305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.412119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 519/1042] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:40.417537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.526612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410cb9-b689-4e21-ac2e-6a216a4fc317 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.549040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.560836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.561516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.567238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.567238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.569719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.571209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1b1fb387-3f7b-40ae-aba0-b6be8e0877df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:40.583459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:40.584611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:40.585870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:40.586321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 524/1043] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:40.592250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.668161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e8b4-57e1-4567-ac2a-738c890f56c4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.668351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e8b4-57e1-4567-ac2a-738c890f56c4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.668620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e8b4-57e1-4567-ac2a-738c890f56c4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.670143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 525/1044] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:40.674896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.675192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.675443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.693436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:40.694567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:40.695807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:40.700820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4fce1-791f-4f32-b5fc-58d3f990bd48 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.736295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.736940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.737237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.737546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.738246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:40.738550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.739984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.752409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 520/1045] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:40.759100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:40.774354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 526/1046] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:40.882235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6b148-f73b-4ca8-8a24-bb8c152056bd None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:40.919311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:40.919924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.920146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.920354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.921108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] RBAC: Adding query filter params (role.id=b10a8aaa59844db9808b917c312357aa, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:40.921415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:40.922840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:40.936983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 521/1047] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:40 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=b10a8aaa59844db9808b917c312357aa => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:41.046138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.152212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78d6dd-d508-47c3-a325-b95594ed4bb3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:41.166485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.187724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:41.188240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.188514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.188815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.198817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:41.203552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:41.204786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:41.205789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 527/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:41.212885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.233456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.316250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28198cd1-4cc6-47bf-99ef-6c893c9a7e91 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:41.350305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:41.350917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.351191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.351458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.352149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:41.352454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:41.353852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:41.363548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 522/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:41.369210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.474591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ccc6-a7be-4438-8224-1ae0f8121187 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:41.512020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:41.512640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.512944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.513213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] PATH_INFO: `/v3/users/c3392ad0074546749616f62fe364d76f` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.528171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] RBAC: Authorizing `identity:get_user(user_id=c3392ad0074546749616f62fe364d76f)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:41.529637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b6d-8148-4bc4-871e-7eeed1c96cbf None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:41.531476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 528/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/users/c3392ad0074546749616f62fe364d76f => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:41.537157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.619081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.638640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed963f-b050-4f62-a76a-754f889fdb74 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:41.673608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:41.674292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.675271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.675558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.736613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bdc0-b33e-48e7-af38-e6a9b3533535 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.736941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bdc0-b33e-48e7-af38-e6a9b3533535 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.737850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bdc0-b33e-48e7-af38-e6a9b3533535 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.739509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 529/1051] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:41.744354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.744639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.744938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.747312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:41.748862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:41.765478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:41.766981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:41.805026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.844713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.858318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 530/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:41.871205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 523/1053] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:41.872918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.977903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249772f-c911-4547-b801-90a5932f0d57 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.014420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.015039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.015312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.015577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.016682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.018112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.025188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 531/1054] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:42.026171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.127851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb744a7-1bd5-490f-8227-f879b70ad103 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.130123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.159873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:42.166124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.166718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.167000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.167265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.168012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=0b692a22ca26467b90c434c507f81aac, user.id=c3392ad0074546749616f62fe364d76f) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:42.168314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.169763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.176783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 524/1055] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:42 2022] GET /identity/v3/role_assignments?user.id=c3392ad0074546749616f62fe364d76f&scope.project.id=0b692a22ca26467b90c434c507f81aac&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:42.249175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce01c3-3f68-426e-9f96-b9fe386f95cb None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.286783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.287336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.287615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.287968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] PATH_INFO: `/v3/services/image` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.288461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.289889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:42.299324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:42.301141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:38:42.302004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:42.305017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 532/1056] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Aug 30 14:38:42 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:42.306997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.357021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:42.414504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce327b4-89f2-40aa-b9d2-a670ca32419a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.448618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.449249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.449524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.449793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.450418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:42.450715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.452075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.462821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 525/1057] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:42.463713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.558777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:42.568052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfd02f-5a9a-40ec-8e1f-4df82f26afac None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.605583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.606212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.606485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.606751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.607373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] RBAC: Adding query filter params (type=image) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:42.607666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.609121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476475f-0a1b-4d2a-a19a-2732f84c1b78 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.621111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 533/1058] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:42.621276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:42.724592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1cc0-a909-4bc0-9851-89edb34553e1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:42.733486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:42.759217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:42.759814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.760089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.760356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.761055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:42.762414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:42.837779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17aa69-314d-4237-9398-43054222f1d1 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.838088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17aa69-314d-4237-9398-43054222f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.838360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17aa69-314d-4237-9398-43054222f1d1 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.839834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 534/1059] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:38:42.841651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 526/1060] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:38:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:38:42.845077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:42.845391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:42.845644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:42.866106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:42.867334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:42.947212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 535/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:43.223400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.332962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a677df-a8a0-4517-9066-095f9ddf4c57 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.367421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.368050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.368329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.368601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.379695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:43.384588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:43.385521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:43.386493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 527/1062] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:43.391710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.475108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.495175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b78781-c730-4f16-9390-b1a13e3a6f32 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.529877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.530475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.530750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.531019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.531678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:43.531975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.533373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.546546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 536/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:43.548122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.575061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.651231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417136-9a4c-40f7-b416-f0af2b6b2468 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.685804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.686427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.686706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.686975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.699333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.700807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:43.715298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:43.716298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:43.722480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:43.722480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:43.722480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:43.722480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 528/1064] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:43.724108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.834378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44163d4-2dcc-448f-987b-ba483b722e93 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:43.873302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:43.873909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.874185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.874455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.875124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:43.875424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:43.876823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:43.889326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 537/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:43.895627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:43.975973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.998831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa046-95c7-4116-b0fa-b3aea9127544 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.033256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.033907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.034211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.034487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.041992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.043448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-3e96e7c4-d9bc-4018-9275-6f47fb17704d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:44.055354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:44.056321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:44.057474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 529/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:44.064386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.069009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.102124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36eeed-bf33-47a8-bd8e-e7e2d8ad645a None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.102437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36eeed-bf33-47a8-bd8e-e7e2d8ad645a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.102677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36eeed-bf33-47a8-bd8e-e7e2d8ad645a None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.104144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 530/1067] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:44.108780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.109064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.109334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.127618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:44.128974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:44.171522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01242-7f4f-45f0-8141-a5679fdf7a70 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.205382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.206572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.206846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.207114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.207830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:44.208129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.208978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 531/1068] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:38:44.209661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.227269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 538/1069] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:44.232845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.297809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.332978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b7ac7-66d8-417c-9d88-3a0eeeef1065 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.367555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.368177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.368456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.368754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.378827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.380274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:44.395049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:44.396024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:44.396993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:44.396993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:44.396993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:44.401159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 532/1070] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:44.402394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.465020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.469464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.507661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a70a-e719-4e8a-ab83-79602821a0fa None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.547972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.548581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.548942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.549221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.549960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:44.550256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.551636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.563664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 539/1071] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:44.569249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.578579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c76ff-9f12-4091-958d-e9cfe40824a1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.598343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.619769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.620400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.620694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.621119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.634211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:44.639067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:44.640034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:44.640923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 533/1072] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:44.646457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.682230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aca1-3c0f-484d-8611-bea16e668518 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.708068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.722473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.723326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.723775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.724240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.733027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.734788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:44.747023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:44.748047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:44.749140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:44.751054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 540/1073] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:44.752625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4bec-134c-4842-89cb-b234e3e9b494 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.757091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.792466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.793191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.793471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.793743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.794415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:44.794721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.796790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.808171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 534/1074] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:44.812639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.858156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.864379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83541-15af-4756-b556-b9e591b0305c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.897606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.898197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.898474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.898738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.899424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:44.899725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.901172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a95b1-d690-4af3-97cd-31b98132d9e0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.918608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 541/1075] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:44.918608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62ddc-144a-4f46-8166-fbd40c7a56e1 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.918608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62ddc-144a-4f46-8166-fbd40c7a56e1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.918608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62ddc-144a-4f46-8166-fbd40c7a56e1 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.918608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 542/1076] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:44.919032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e35b-3182-4a85-8fd8-eb17af354124 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.921336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62ddc-144a-4f46-8166-fbd40c7a56e1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.951394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.952012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.952347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.952624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] PATH_INFO: `/v3/users/c3392ad0074546749616f62fe364d76f` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.953770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] RBAC: Authorizing `identity:get_user(user_id=c3392ad0074546749616f62fe364d76f)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.955207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69c4f-c73e-476d-9c6d-bc925d6ada3c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.957226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 535/1077] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/users/c3392ad0074546749616f62fe364d76f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:44.958314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.958589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.958855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.968822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.976556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:44.977767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:45.027545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62ddc-144a-4f46-8166-fbd40c7a56e1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.045341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 536/1078] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:45.046338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:45.062929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.063616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.063894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.064158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/b10a8aaa59844db9808b917c312357aa` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.066734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=200f4c80511443c4bc7315a450a917e3, role_id=b10a8aaa59844db9808b917c312357aa)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.068151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:45.086765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:45.140786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 543/1079] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:44 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/200f4c80511443c4bc7315a450a917e3/roles/b10a8aaa59844db9808b917c312357aa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:45.146388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31928a-33c1-4ed8-8d32-e47e7e6c8c82 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.187237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.189572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.189572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.189572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.190276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.191847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:45.193919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 537/1080] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:45 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:45.199977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:45.311725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9533d82-1527-421a-a85a-669448fece42 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.314668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:45.316470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:45.352051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.352762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.353082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.353557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac/users/c3392ad0074546749616f62fe364d76f/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.356189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] RBAC: Authorizing `identity:create_grant(project_id=0b692a22ca26467b90c434c507f81aac, user_id=c3392ad0074546749616f62fe364d76f, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.357663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:45.423862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410eab5-3aca-490f-a1e3-26f2c049f31b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.431822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:45.452957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 544/1081] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:45 2022] PUT /identity/v3/projects/0b692a22ca26467b90c434c507f81aac/users/c3392ad0074546749616f62fe364d76f/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:45.471957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.472816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.473102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.473420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.555598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.557131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:45.667055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 538/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:45.672837 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:45.773536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c0f0-ccb9-464e-a04b-e1b7b248a4af None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.815339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.816252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.816747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.817199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.827737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.829491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-67c880df-22f1-4d24-bc99-3f13ebd4e67c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:45.844261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:45.845284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:45.846201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:45.846201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:45.846201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:45.847035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 545/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:45.853147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:45.861322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:45.954524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342557c-fafc-4615-969b-8ae461e4ad56 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:45.989647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:45.990245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:45.990522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:45.990790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:45.991427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:45.991727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:45.993123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbf5d1-c8ee-4858-9b11-c2e616f2c16f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:46.012686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 539/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:47.089711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb64a-ccec-4a3c-bf51-23c32ccb7254 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.090253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb64a-ccec-4a3c-bf51-23c32ccb7254 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.090253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb64a-ccec-4a3c-bf51-23c32ccb7254 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.091508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 546/1085] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:47.097382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f498e-7aac-40bf-bb78-8d884159ef86 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.097866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f498e-7aac-40bf-bb78-8d884159ef86 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.097982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f498e-7aac-40bf-bb78-8d884159ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.115757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9a9f498e-7aac-40bf-bb78-8d884159ef86 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:47.116982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9a9f498e-7aac-40bf-bb78-8d884159ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:47.177601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:47.185063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 540/1086] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:47.381627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f596-fa18-493b-8cc9-b63d9f5c29c3 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.381827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f596-fa18-493b-8cc9-b63d9f5c29c3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.382082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f596-fa18-493b-8cc9-b63d9f5c29c3 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.383412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 547/1087] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:47.388561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.388887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.389170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.407396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:47.408569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:47.457043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999f596-fa18-493b-8cc9-b63d9f5c29c3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.473570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:47.474144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 541/1088] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:47.558276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999f596-fa18-493b-8cc9-b63d9f5c29c3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:47.590989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:47.591620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.591892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.592155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.602092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:47.606767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:47.607844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:47.609761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 548/1089] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:47.614323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.714973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c3b1-0128-4617-ae0c-d017296f88f1 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:47.740678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:47.749214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.752350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:47.752350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.752350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.752350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.752858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:47.752858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:47.753001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:47.761133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 542/1090] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:47.766678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.827487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:47.852367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf8aa-e5f9-406f-8dd2-aae0b6fb9813 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:47.867577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3385b9-c58c-4834-9148-81d4f9e225c5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:47.887479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:47.888504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.888812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.889084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.899573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:38:47.902354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:47.902970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.903246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.903514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:38:47.905049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:47.905945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:38:47.907086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 549/1091] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:47.912609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.918529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:47.919984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:47.934231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:47.935373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:47.936461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:47.936461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:47.936461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:47.936461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 543/1092] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:47.941542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.982339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.012240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafccffa-62ae-4cbf-b805-a4a6f264892d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.040639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66960-71ec-4526-8402-cc64f0e39798 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.045591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.046182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.046454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.046720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.047368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:48.047662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.049050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.051013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.058169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 550/1093] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:48.063941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.076890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.077492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.077766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.078036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.078681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:48.078981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.080348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.092119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 544/1094] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:48.098388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.164542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5410a5-572f-4092-ae77-6fd26476acab None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.197516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.198138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.198409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.198674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] PATH_INFO: `/v3/users/c3392ad0074546749616f62fe364d76f` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.199797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] RBAC: Authorizing `identity:get_user(user_id=c3392ad0074546749616f62fe364d76f)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.200761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.201497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.202824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 551/1095] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/users/c3392ad0074546749616f62fe364d76f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:48.208294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb70e-2e53-46d3-9ea4-263d6e2364ac None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.208987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.255723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.256347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.256621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.256914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.263783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.265251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.270223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:38:48.276862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:48.283298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 545/1096] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:48.285413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.310709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6782-ec79-4d96-a5bd-d8750ccccaf6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.344502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.345115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.345387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.345648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.385335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb16-9a04-4153-9bc1-eea8f4400f45 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.415475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.416966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.419562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.420160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.420437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.420730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.421458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:48.421763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.423180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.440369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 546/1097] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:48.446078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.464428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.477609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.516552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 552/1098] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:48.523143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.551974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dcdf1-003a-48cc-814b-16f1e0499b9d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.586717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.587316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.587592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.587860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.626925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ff45-156e-46b0-9bb0-99878d12348d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.654755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.656207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.660873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.661480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.661751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.662018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.663112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.664516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.666306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 553/1099] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:48.672201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.673940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.702899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.755705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 547/1100] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:38:48.761430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:48.770996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0ff91-4aa4-4941-bc66-e65f9127e4b3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.810864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.811461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.811734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.812004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.812753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=0b692a22ca26467b90c434c507f81aac, user.id=c3392ad0074546749616f62fe364d76f) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:48.813056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.814485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.820978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 554/1101] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/role_assignments?user.id=c3392ad0074546749616f62fe364d76f&scope.project.id=0b692a22ca26467b90c434c507f81aac&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:38:48.865843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb582b-6ca3-41ac-8354-a4b2c857bfe8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:48.885028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:48.903341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:48.903976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:48.904258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:48.904533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:48.916574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:48.918177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:38:48.935155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:48.936291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:38:48.937615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:38:48.937615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:38:48.937615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:48.937615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 548/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:38:48.942250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.040087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.045544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e0e6-61df-4c4d-b06a-7914b57fa62a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.078012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.078600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.079155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.079584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.081169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:49.081474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.082993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.094169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 555/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:49.100435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.199031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596547a-80c0-4dad-8d59-ba51226e6bc2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.232879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.233488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.233768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.234041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.240587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.242055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:38:49.253115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:38:49.254015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:38:49.254927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 549/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:38:49.259978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.359382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47b076-7b5c-48b6-ba42-9cf3bc48da1b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.392337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.393518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.393796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.394065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.394930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:49.395233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.396652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3d378-3dcd-429d-955f-92743f1008dc None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.408545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 556/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:49.415223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.445488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.514775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3380ff-592d-4e84-b6ea-a506961a7bf3 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:49.547599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:49.548210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.548488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.548791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.550123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] RBAC: Adding query filter params (role.id=b10a8aaa59844db9808b917c312357aa, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=200f4c80511443c4bc7315a450a917e3) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:49.550433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:49.551862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f726-1990-4293-9909-4b2de7e0a109 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:49.557601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 550/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/role_assignments?user.id=200f4c80511443c4bc7315a450a917e3&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=b10a8aaa59844db9808b917c312357aa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:50.773088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba826f89-bc4b-427b-963c-5a17d6e7649c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:50.773623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba826f89-bc4b-427b-963c-5a17d6e7649c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:50.773623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba826f89-bc4b-427b-963c-5a17d6e7649c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:50.774981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 557/1107] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:50.780313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:50.780750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:50.780875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:50.799124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:50.800297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:50.866199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 551/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:51.133015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba826f89-bc4b-427b-963c-5a17d6e7649c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:51.150819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:51.231890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba826f89-bc4b-427b-963c-5a17d6e7649c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:51.264580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:51.265205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:51.265481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:51.265749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:51.266852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:51.268479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73fab7-47b4-4e73-805a-509bfc229874 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:51.270043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 558/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:51.275734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:51.300842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:51.372308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc9777-9f94-4611-8e30-13fe138e4409 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:51.405845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:51.406364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:51.406634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:51.406894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:51.407530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:51.409915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332e74-e9fd-4aeb-91c9-7ac778180cf4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:51.501908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 552/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:38:51 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:38:53.433635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ce5-b7ea-499a-be31-3d98de65d71f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:53.434203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ce5-b7ea-499a-be31-3d98de65d71f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:53.434203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ce5-b7ea-499a-be31-3d98de65d71f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:53.435481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 559/1111] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:53.441152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:53.441568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:53.441712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:53.460096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:53.461300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:53.525086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 553/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:53.793569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af1ce5-b7ea-499a-be31-3d98de65d71f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:53.876386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:53.894626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af1ce5-b7ea-499a-be31-3d98de65d71f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:53.928037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:53.928645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:53.928941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:53.929206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] PATH_INFO: `/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:53.930564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] RBAC: Authorizing `identity:get_role(role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:53.931932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:53.933254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 560/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:53 2022] GET /identity/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:53.939029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:53.950405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.035931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ff35-84b6-4fb8-91fe-ad36c7b92c4a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.068805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.069364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.069645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.069921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] PATH_INFO: `/v3/users/d46a0eede5fe4b06970a0976265e429b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.082681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=d46a0eede5fe4b06970a0976265e429b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.084143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:54.085779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 554/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:53 2022] GET /identity/v3/users/d46a0eede5fe4b06970a0976265e429b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:54.091413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:54.188098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975221b-77cd-48ac-a647-2103d80d91be None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.220335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.220951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.221228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.222123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.243674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.289165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.290605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:54.384687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 561/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:38:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:54.390543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:54.455785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.488317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f288-f4a8-422f-a94a-dd45bdcbe4b4 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.523737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.524360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.524642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.525017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.526132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.527834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eaeac-87a2-4f0a-936a-ad08f0ea35a4 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:54.529505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 555/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:54 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:54.535701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:54.586278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:54.632006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82adc5-a4d8-47b7-8da1-4955bea353b9 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:54.664579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:54.665127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:54.665403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:54.665671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:54.666380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=0b692a22ca26467b90c434c507f81aac, user.id=d46a0eede5fe4b06970a0976265e429b) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:38:54.666682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:54.668096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359fac-0cf6-4797-bc73-3234e176a438 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:54.673322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 562/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:38:54 2022] GET /identity/v3/role_assignments?user.id=d46a0eede5fe4b06970a0976265e429b&scope.project.id=0b692a22ca26467b90c434c507f81aac&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:56.542524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f3e5-7d04-4eab-a6ff-5a1edf686cc6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:56.543051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f3e5-7d04-4eab-a6ff-5a1edf686cc6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:56.543051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f3e5-7d04-4eab-a6ff-5a1edf686cc6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:56.544391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 556/1118] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:56.549968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:56.550391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:56.550529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:56.568752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:56.569920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:56.633753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 563/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:56.898495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f3e5-7d04-4eab-a6ff-5a1edf686cc6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:56.997492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f3e5-7d04-4eab-a6ff-5a1edf686cc6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.029493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.030094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.030368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.030634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] PATH_INFO: `/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.031993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] RBAC: Authorizing `identity:get_role(role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.033384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.035224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 557/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:56 2022] GET /identity/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:57.040932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:57.087079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:57.156877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d6bce-4489-46c1-89aa-32cebef917b4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.190256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.190862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.191141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.191414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] PATH_INFO: `/v3/users/d46a0eede5fe4b06970a0976265e429b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.192528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] RBAC: Authorizing `identity:get_user(user_id=d46a0eede5fe4b06970a0976265e429b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.193987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.195550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 564/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:57 2022] GET /identity/v3/users/d46a0eede5fe4b06970a0976265e429b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:57.201285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:57.205016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:57.301297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146a48-fa11-492d-86a1-ddd4e9c5d678 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.334711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.335328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.335608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.335880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.337017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.338508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaee5fd-08ac-4821-9e7f-a8df32a4c6d9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.340083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 558/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:38:57 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:57.346030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:57.452069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143fe61-1371-425a-aa22-34ebfd99c279 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:57.465118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:57.484207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:57.484873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:57.485153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:57.485422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac/users/d46a0eede5fe4b06970a0976265e429b/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:57.488134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=0b692a22ca26467b90c434c507f81aac, user_id=d46a0eede5fe4b06970a0976265e429b, role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:57.489594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c64b7-33ae-4b22-bbeb-2995ba2e2aeb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:57.556457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 565/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:38:57 2022] PUT /identity/v3/projects/0b692a22ca26467b90c434c507f81aac/users/d46a0eede5fe4b06970a0976265e429b/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:38:59.419407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af45c-939d-47a7-91cb-b21b9627439c None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:59.419998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af45c-939d-47a7-91cb-b21b9627439c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:59.419998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24af45c-939d-47a7-91cb-b21b9627439c None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:59.421477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 559/1124] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:59.427374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:59.427828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:59.427933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:59.446948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:59.448109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:59.534291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 566/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:38:59.807738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24af45c-939d-47a7-91cb-b21b9627439c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:59.878158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:59.907631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24af45c-939d-47a7-91cb-b21b9627439c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:59.940626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:59.941263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:59.941541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:59.941810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] PATH_INFO: `/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:59.943276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] RBAC: Authorizing `identity:get_role(role_id=ad2b0ca6c7e34ec79e97003e143a9b79)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:59.944649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:59.945970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 560/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:59 2022] GET /identity/v3/roles/ad2b0ca6c7e34ec79e97003e143a9b79 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:38:59.951841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.047333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c21b-670a-4e78-a360-63697b2a8279 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.049605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.080220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.080981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.081264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.081535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] PATH_INFO: `/v3/users/d46a0eede5fe4b06970a0976265e429b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.082645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] RBAC: Authorizing `identity:get_user(user_id=d46a0eede5fe4b06970a0976265e429b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.084062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.085654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 567/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:38:59 2022] GET /identity/v3/users/d46a0eede5fe4b06970a0976265e429b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:00.091418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.190250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442fc7-a122-4d05-b91c-7f780db95e3c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.222740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.223326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.223600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.223868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.233645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.288961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.290399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.386435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 561/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:00.392305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.488454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae204-8530-4b3e-bf31-81f2d6379550 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.521581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.522186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.522461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.522730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] PATH_INFO: `/v3/projects/0b692a22ca26467b90c434c507f81aac` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.523821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] RBAC: Authorizing `identity:get_project(project_id=0b692a22ca26467b90c434c507f81aac)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.525266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca58c2-c356-47a5-993c-d540578bc6af None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.527121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 568/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/projects/0b692a22ca26467b90c434c507f81aac => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:00.533371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:00.574339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:00.630400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd747d-832c-46dc-bf04-e5affbd18fb5 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:00.663653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:00.664189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:00.664471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:00.664767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:00.665487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] RBAC: Adding query filter params (role.id=ad2b0ca6c7e34ec79e97003e143a9b79, scope.project.id=0b692a22ca26467b90c434c507f81aac, user.id=d46a0eede5fe4b06970a0976265e429b) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:00.665801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:00.667228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648ae18-28f8-4488-8c79-24de92dd7be0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:00.672823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 562/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:00 2022] GET /identity/v3/role_assignments?user.id=d46a0eede5fe4b06970a0976265e429b&scope.project.id=0b692a22ca26467b90c434c507f81aac&role.id=ad2b0ca6c7e34ec79e97003e143a9b79 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:02.584072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992bc4-181d-41bb-bb71-e916c2c2aa25 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:02.584609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992bc4-181d-41bb-bb71-e916c2c2aa25 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:02.584609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992bc4-181d-41bb-bb71-e916c2c2aa25 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:02.585977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 569/1131] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:02.590978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:02.591354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:02.591519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:02.609971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:02.611135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:02.677117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 563/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:02.947312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992bc4-181d-41bb-bb71-e916c2c2aa25 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:02.988696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.045215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992bc4-181d-41bb-bb71-e916c2c2aa25 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.077527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.078131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.078405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.078673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.079767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.081866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b1428-769c-4524-bf71-bdd9d601cd3f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:03.083400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 570/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:03.089118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:03.121367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.185661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ab63-f4fd-4470-8ab4-f24ddd42b809 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:03.219560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:03.220095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:03.220373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:03.220703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:03.221416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:03.222829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d101e73-d653-42d6-92c3-17a6979c6210 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:03.328335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 564/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:39:03 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:39:05.235267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050eef-7fb4-4264-93fe-4f3023307105 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.235795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050eef-7fb4-4264-93fe-4f3023307105 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.235795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050eef-7fb4-4264-93fe-4f3023307105 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.237788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 571/1135] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:05.242845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.243305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.243398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.261463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:05.262759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:05.327902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 565/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:05.602738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050eef-7fb4-4264-93fe-4f3023307105 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:05.702199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050eef-7fb4-4264-93fe-4f3023307105 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:05.711105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:05.734343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:05.734935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.735207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.735471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.737124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:05.738541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8526e-e18e-4dbc-8489-6c6f284b7f48 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:05.740079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 572/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:05.745913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:05.763758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:05.844198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8061b-8256-4dfc-a43a-dcd2bcae9134 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:05.878529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:05.879069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:05.879349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:05.879621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:05.880283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:05.881773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8f232-a798-4bed-9e25-37891482feb0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:06.007201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 566/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:39:05 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:39:07.934929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a981a-e529-47c5-80e5-545163c780cc None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:07.935464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a981a-e529-47c5-80e5-545163c780cc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:07.935464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a981a-e529-47c5-80e5-545163c780cc None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:07.936828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 573/1139] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:07.942045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:07.942481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:07.942581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:07.960956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:07.962128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:08.026700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 567/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:08.296505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a981a-e529-47c5-80e5-545163c780cc None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:08.394414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a981a-e529-47c5-80e5-545163c780cc None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:08.426866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:08.427461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:08.427732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:08.427999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:08.437668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:08.442994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:08.444193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:08.445543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 574/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:08.449943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:08.452106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:08.548175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc5321-6e1d-4033-bbab-ee2a74ce99f5 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:08.581688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:08.582279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:08.582557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:08.582827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:08.583489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:08.583791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:08.585192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:08.592969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 568/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:08.599118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:08.635019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:08.698386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777844-2c3a-4112-8d99-9a6ed146110b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:08.732173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:08.732862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:08.733134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:08.733398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] PATH_INFO: `/v3/users/9b66e6a3ac454a93a07d3958925a2eb8` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:08.746705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] RBAC: Authorizing `identity:get_user(user_id=9b66e6a3ac454a93a07d3958925a2eb8)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:08.748124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:08.749705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 575/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:08 2022] GET /identity/v3/users/9b66e6a3ac454a93a07d3958925a2eb8 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:08.756021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:08.828587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:08.866908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e6491-845a-42e3-aa07-8823883fd915 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:08.900059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:08.900772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:08.901050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:08.901315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:08.967367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:08.968825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:09.027462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:09.064852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 569/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:09.070839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:09.161238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:09.167544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c440ce-033b-4a87-9d93-32e4829dd95e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:09.201769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:09.202376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:09.202651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:09.202917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] PATH_INFO: `/v3/projects/1677d5a79a2a4b17b3b04380c912f12b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:09.204018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] RBAC: Authorizing `identity:get_project(project_id=1677d5a79a2a4b17b3b04380c912f12b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:09.205533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8b1d5-8437-41e5-8698-2740711fa784 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:09.207142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 576/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:09 2022] GET /identity/v3/projects/1677d5a79a2a4b17b3b04380c912f12b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:09.213345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:09.310871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb497a-f454-430d-b439-0523581e5d10 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:09.344127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:09.344650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:09.344958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:09.345248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:09.345967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=1677d5a79a2a4b17b3b04380c912f12b, user.id=9b66e6a3ac454a93a07d3958925a2eb8) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:09.346272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:09.347699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a2543-b3c2-4a74-a737-aa26604cff90 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:09.352976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 570/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:09 2022] GET /identity/v3/role_assignments?user.id=9b66e6a3ac454a93a07d3958925a2eb8&scope.project.id=1677d5a79a2a4b17b3b04380c912f12b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:11.240850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb04c-4d42-464b-a8b5-7d26af254d90 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:11.241384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb04c-4d42-464b-a8b5-7d26af254d90 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:11.241384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb04c-4d42-464b-a8b5-7d26af254d90 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:11.242707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 577/1147] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:11.247986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:11.248405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:11.248535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:11.266653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:11.268555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:11.290673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:11.333981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 571/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:11.600915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecb04c-4d42-464b-a8b5-7d26af254d90 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:11.701069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecb04c-4d42-464b-a8b5-7d26af254d90 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:11.733246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:11.733855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:11.734130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:11.734398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:11.745236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:11.749979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:11.751088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:11.752715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 578/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:11.757768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:11.857133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0542-da43-412c-bbc4-edfb9cc6039e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:11.890885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:11.891482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:11.891760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:11.892085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:11.892917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:11.893217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:11.894583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:11.902590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 572/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:11.909054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:11.933961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:12.006279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f9e2b-05f6-475b-a5dd-c2d37e945519 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:12.039234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:12.039833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:12.040111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:12.040379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] PATH_INFO: `/v3/users/9b66e6a3ac454a93a07d3958925a2eb8` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:12.041524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] RBAC: Authorizing `identity:get_user(user_id=9b66e6a3ac454a93a07d3958925a2eb8)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:12.042932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:12.044474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 579/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:11 2022] GET /identity/v3/users/9b66e6a3ac454a93a07d3958925a2eb8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:12.050862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:12.073394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:12.151081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26e33-0067-486b-8d14-b210ec3c2962 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:12.187017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:12.187638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:12.187920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:12.188196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] PATH_INFO: `/v3/projects/1677d5a79a2a4b17b3b04380c912f12b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:12.189354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] RBAC: Authorizing `identity:get_project(project_id=1677d5a79a2a4b17b3b04380c912f12b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:12.190793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf319-2173-4fe0-b8f5-4c885c14821d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:12.192437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 573/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:12 2022] GET /identity/v3/projects/1677d5a79a2a4b17b3b04380c912f12b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:12.198409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:12.287154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:12.296302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e102-ce93-4622-94d3-7a47c8008f67 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:12.329246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:12.330409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:12.330675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:12.330933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] PATH_INFO: `/v3/projects/1677d5a79a2a4b17b3b04380c912f12b/users/9b66e6a3ac454a93a07d3958925a2eb8/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:12.332801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] RBAC: Authorizing `identity:create_grant(project_id=1677d5a79a2a4b17b3b04380c912f12b, user_id=9b66e6a3ac454a93a07d3958925a2eb8, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:12.334209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85d9d2-a738-486b-ad1e-6e4691e0e806 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:12.403764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 580/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:39:12 2022] PUT /identity/v3/projects/1677d5a79a2a4b17b3b04380c912f12b/users/9b66e6a3ac454a93a07d3958925a2eb8/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:39:14.276721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d570-e574-4bb7-b791-4429615b6c1b None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:14.277255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d570-e574-4bb7-b791-4429615b6c1b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:14.277255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d570-e574-4bb7-b791-4429615b6c1b None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:14.278612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 574/1154] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:14.284222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:14.284638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:14.284803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:14.303011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:14.304178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:14.367719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 581/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:14.638407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d570-e574-4bb7-b791-4429615b6c1b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:14.727100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:14.739884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d570-e574-4bb7-b791-4429615b6c1b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:14.773777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:14.774390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:14.774669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:14.774942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:14.785763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:14.790574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:14.791743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:39:14.792602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 575/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:14.797669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:14.879634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:14.898717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e0a9c-505b-4b66-9803-a9259591fb97 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:14.932449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:14.933072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:14.933350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:14.933616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:14.934265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:14.934566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:14.935915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:14.944759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 582/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:14.950300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:15.047526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a135e1-0a9c-4ba0-bacd-0280c7cf36cb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:15.080644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:15.081270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:15.081548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:15.081818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] PATH_INFO: `/v3/users/9b66e6a3ac454a93a07d3958925a2eb8` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:15.082923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] RBAC: Authorizing `identity:get_user(user_id=9b66e6a3ac454a93a07d3958925a2eb8)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:15.084357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:15.085930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 576/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:14 2022] GET /identity/v3/users/9b66e6a3ac454a93a07d3958925a2eb8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:15.091800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:15.187911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80e47-2d74-4d9e-bb11-55250132d8f2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:15.219545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:15.220638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:15.221026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:15.221298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:15.232630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:15.287012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:15.288439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:15.381188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 583/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:15.387192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:15.405519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:15.484867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bedc-7ccc-453e-ae70-be4a2d168e73 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:15.518682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:15.519298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:15.519575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:15.519845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] PATH_INFO: `/v3/projects/1677d5a79a2a4b17b3b04380c912f12b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:15.520979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] RBAC: Authorizing `identity:get_project(project_id=1677d5a79a2a4b17b3b04380c912f12b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:15.522426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458ee0-31dd-421b-82bd-e10db5682749 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:15.524277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 577/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:15 2022] GET /identity/v3/projects/1677d5a79a2a4b17b3b04380c912f12b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:15.530877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:15.574240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:15.632177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077cca-230b-44ab-a08e-ea8ac84e88eb None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:15.666510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:15.667087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:15.667357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:15.667733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:15.668441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=1677d5a79a2a4b17b3b04380c912f12b, user.id=9b66e6a3ac454a93a07d3958925a2eb8) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:15.668764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:15.670170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda0b7-443d-4916-ba79-fccf9eb0c186 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:15.676077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 584/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:15 2022] GET /identity/v3/role_assignments?user.id=9b66e6a3ac454a93a07d3958925a2eb8&scope.project.id=1677d5a79a2a4b17b3b04380c912f12b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:17.616413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb57ac-fbf2-40dd-b0dd-81eaeda5b9b1 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:17.616977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb57ac-fbf2-40dd-b0dd-81eaeda5b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:17.616977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb57ac-fbf2-40dd-b0dd-81eaeda5b9b1 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:17.618304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 578/1162] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:17.623369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:17.623757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:17.623907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:17.647307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:17.648474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:17.713955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 585/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:17.982933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb57ac-fbf2-40dd-b0dd-81eaeda5b9b1 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:18.066329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:18.082921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb57ac-fbf2-40dd-b0dd-81eaeda5b9b1 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:18.116058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:18.116653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:18.116955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:18.117227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:18.182097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:18.183532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:18.263438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:18.279243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 579/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:18.285206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:18.319239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:18.380755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235e599-84b8-43bc-9fec-ce4656f2dc6a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:18.413971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:18.414571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:18.414841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:18.415104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:18.421515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:18.423166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-51a7cca9-94d8-4453-81fa-fb64ccaaea11 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:18.434112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:18.435414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:18.436499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 586/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:39:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:18.441309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:18.539570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a9b0-4621-4e93-bb1a-15ac5de4d441 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:18.571975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:18.572555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:18.572861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:18.573129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:18.573766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:18.574068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:18.575431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eeb3f-4bad-48cf-91ad-4ccf92ac0441 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:18.582933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 580/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Aug 30 14:39:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:20.468209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4203a5-3a29-4926-90ae-898ee1835bdf None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:20.468789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4203a5-3a29-4926-90ae-898ee1835bdf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:20.468789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4203a5-3a29-4926-90ae-898ee1835bdf None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:20.470629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 587/1167] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:20.475932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9ea4-c200-4acd-95c6-6d980c7e966c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:20.476329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9ea4-c200-4acd-95c6-6d980c7e966c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:20.476478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9ea4-c200-4acd-95c6-6d980c7e966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:20.494969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a8af9ea4-c200-4acd-95c6-6d980c7e966c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:20.496140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a8af9ea4-c200-4acd-95c6-6d980c7e966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:20.539271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:20.561875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 581/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:20.832018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4203a5-3a29-4926-90ae-898ee1835bdf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:20.925543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:20.932079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4203a5-3a29-4926-90ae-898ee1835bdf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:20.964513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:20.965145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:20.965417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:20.965680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:20.966332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:20.967681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19805a-19ef-45c4-90de-68003a187527 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:21.039156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 588/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Tue Aug 30 14:39:20 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:39:22.932715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2023e-310f-4242-9ba1-c042573c0dcb None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:22.933252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2023e-310f-4242-9ba1-c042573c0dcb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:22.933252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2023e-310f-4242-9ba1-c042573c0dcb None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:22.934598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 582/1170] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:22.939823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:22.940342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:22.940342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:22.958533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:22.959694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:23.023870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 589/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:39:23.288975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2023e-310f-4242-9ba1-c042573c0dcb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:23.389141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2023e-310f-4242-9ba1-c042573c0dcb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:23.422348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:23.423837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:23.424119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:23.424389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] PATH_INFO: `/v3/domains/384364724f9445cda27beed614899177` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:23.434288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=384364724f9445cda27beed614899177)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:23.435714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fdb95-86ec-4629-885a-83f366de99e9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:23.437282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 583/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Aug 30 14:39:23 2022] GET /identity/v3/domains/384364724f9445cda27beed614899177 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:23.443300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:23.523902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:23.538143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545059f-3ef5-414c-94b6-f8d58fdff4af None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:23.573014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:23.573531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:23.573803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:23.574068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:23.574703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:23.576093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f50c9b-710d-4938-bd4f-5dd38e6f54d1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:23.687549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 590/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:39:23 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:39:25.626138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8f0b5-98c5-4bce-81fb-e848348c44bc None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:25.626666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8f0b5-98c5-4bce-81fb-e848348c44bc None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:25.626666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8f0b5-98c5-4bce-81fb-e848348c44bc None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:25.628014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 584/1174] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:25.633213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:25.633606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:25.633762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:25.652337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:25.653530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:25.718525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 591/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:25.988732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8f0b5-98c5-4bce-81fb-e848348c44bc None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:26.028890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:26.087501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8f0b5-98c5-4bce-81fb-e848348c44bc None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:26.119819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:26.120426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:26.120726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:26.120997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] PATH_INFO: `/v3/domains/384364724f9445cda27beed614899177` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:26.122090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] RBAC: Authorizing `identity:get_domain(domain_id=384364724f9445cda27beed614899177)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:26.123517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680f4c-f74c-484f-9f8d-db672f3651da None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:26.125083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 585/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Aug 30 14:39:25 2022] GET /identity/v3/domains/384364724f9445cda27beed614899177 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:26.131019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:26.195134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:26.227956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b36b-e52f-49f4-b5fd-27ebe36944f2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:26.265240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:26.265770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:26.266127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:26.266449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:26.267078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:26.268503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac215ef-4a17-4a06-b548-603e4386af7a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:26.349524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 592/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:39:26 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:39:28.311146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4bbf-2b03-410f-a1cc-1db9031ac130 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:28.311690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4bbf-2b03-410f-a1cc-1db9031ac130 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:28.311690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4bbf-2b03-410f-a1cc-1db9031ac130 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:28.313929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 586/1178] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:28.319162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:28.319586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:28.319699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:28.337254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:28.338423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:28.402823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 593/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:28.673449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e4bbf-2b03-410f-a1cc-1db9031ac130 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:28.842642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e4bbf-2b03-410f-a1cc-1db9031ac130 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:28.849452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:28.876558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:28.877192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:28.877467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:28.877732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:28.887749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:28.892519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:28.893799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:39:28.895032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 587/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:28.899694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:28.952968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:28.996597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359a3c-5a42-43bf-8e69-59a710e92d96 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:29.029887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:29.030474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:29.030747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:29.031016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:29.031716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:29.032192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:29.033582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:29.041227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 594/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:29.047522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:29.145763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42144b-20e2-4c85-bca4-e1800f347ddc None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:29.179087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:29.179692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:29.179962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:29.180226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] PATH_INFO: `/v3/users/e2c0ee165e3742cf98ea3b28b40b617d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:29.193133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] RBAC: Authorizing `identity:get_user(user_id=e2c0ee165e3742cf98ea3b28b40b617d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:29.194560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:29.196109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 588/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:29 2022] GET /identity/v3/users/e2c0ee165e3742cf98ea3b28b40b617d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:29.201957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:29.296802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f15a3-29a1-4d58-9d80-495f7a999e1b None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:29.312450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:29.329315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:29.329907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:29.330155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:29.330420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:29.395944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:29.397436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:29.490733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 595/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:29.496576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:29.522299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:29.602260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d179c5-dc3f-484d-808c-38c46b7590de None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:29.634974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:29.635591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:29.635874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:29.636147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] PATH_INFO: `/v3/projects/0024d9492bb44201acb899867787b4e7` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:29.637277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] RBAC: Authorizing `identity:get_project(project_id=0024d9492bb44201acb899867787b4e7)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:29.638713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645d50-49ae-4e41-b86a-0c9cc5d30d0d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:29.640324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 589/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:29 2022] GET /identity/v3/projects/0024d9492bb44201acb899867787b4e7 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:29.647046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:29.664762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:29.742810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085fd72-d40c-498b-807f-2ed627f7338d None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:29.775553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:29.776401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:29.776696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:29.776972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:29.777684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=0024d9492bb44201acb899867787b4e7, user.id=e2c0ee165e3742cf98ea3b28b40b617d) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:29.777991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:29.779413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc085a33-dd0f-4c67-8f6e-3eb235f319d6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:29.785383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 596/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:29 2022] GET /identity/v3/role_assignments?user.id=e2c0ee165e3742cf98ea3b28b40b617d&scope.project.id=0024d9492bb44201acb899867787b4e7&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:31.658127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897f25-fb33-400c-b457-9a0e817d091e None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:31.658682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897f25-fb33-400c-b457-9a0e817d091e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:31.658682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897f25-fb33-400c-b457-9a0e817d091e None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:31.660001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 590/1186] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:31.665086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:31.665518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:31.665648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:31.683908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:31.685113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:31.751302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 597/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:32.020952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5897f25-fb33-400c-b457-9a0e817d091e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:32.110444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:32.119446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5897f25-fb33-400c-b457-9a0e817d091e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:32.152078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:32.152713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:32.153016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:32.153326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:32.164170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:32.168988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:32.170059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:39:32.170931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 591/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:32.176209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:32.188093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:32.273290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac45e4-aaf0-4f0c-a619-9c5e36e11531 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:32.306644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:32.307227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:32.307498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:32.307763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:32.308409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:32.308734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:32.310082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:32.318139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 598/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:32.324010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:32.421289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6ee3-9bba-493a-a76f-e4a7ee7fdee1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:32.453579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:32.454180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:32.454458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:32.454728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] PATH_INFO: `/v3/users/e2c0ee165e3742cf98ea3b28b40b617d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:32.455836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c0ee165e3742cf98ea3b28b40b617d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:32.457298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:32.458836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 592/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:32 2022] GET /identity/v3/users/e2c0ee165e3742cf98ea3b28b40b617d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:32.464572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:32.534486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:32.563100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb928-20ee-427b-9be3-e58f89fcfe3e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:32.596508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:32.597277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:32.597557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:32.597830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] PATH_INFO: `/v3/projects/0024d9492bb44201acb899867787b4e7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:32.598945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] RBAC: Authorizing `identity:get_project(project_id=0024d9492bb44201acb899867787b4e7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:32.600366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8dfa6-bf89-4a67-8c93-2b1f9fbe1e9b None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:32.602014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 599/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:32 2022] GET /identity/v3/projects/0024d9492bb44201acb899867787b4e7 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:32.607904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:32.629628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:32.706858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa99b8-a692-4b31-8031-907abe401231 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:32.739602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:32.740242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:32.740521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:32.740823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] PATH_INFO: `/v3/projects/0024d9492bb44201acb899867787b4e7/users/e2c0ee165e3742cf98ea3b28b40b617d/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:32.742731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0024d9492bb44201acb899867787b4e7, user_id=e2c0ee165e3742cf98ea3b28b40b617d, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:32.744161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab9c86-c44c-4e30-85fb-c31ba23511f9 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:32.819741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 593/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:39:32 2022] PUT /identity/v3/projects/0024d9492bb44201acb899867787b4e7/users/e2c0ee165e3742cf98ea3b28b40b617d/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:39:34.788148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e8b94-3b65-476d-bc58-636269740f8d None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:34.788721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e8b94-3b65-476d-bc58-636269740f8d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:34.788721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e8b94-3b65-476d-bc58-636269740f8d None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:34.790154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 600/1193] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:39:34.795352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:34.795736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:34.795904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:34.814173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:39:34.815339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:39:34.880082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 594/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:39:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:39:35.154145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e8b94-3b65-476d-bc58-636269740f8d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:35.252885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e8b94-3b65-476d-bc58-636269740f8d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:35.285768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:35.286374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:35.286651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:35.286920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:35.294185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:35.297794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:39:35.302522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:39:35.303503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:39:35.304369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 601/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:39:35.315766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:35.320901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:35.406362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a614c-46e0-42f9-a5f7-db2c4da09910 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:35.439901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:35.440487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:35.440791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:35.441088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:35.441744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:35.442043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:35.443404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:35.451234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 595/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:35.457038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:35.555604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba051b7-7473-4ce2-bb36-5eb4fcc4759c None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:35.588257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:35.588873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:35.589147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:35.589411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] PATH_INFO: `/v3/users/e2c0ee165e3742cf98ea3b28b40b617d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:35.590500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c0ee165e3742cf98ea3b28b40b617d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:35.591918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:35.594126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 602/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Aug 30 14:39:35 2022] GET /identity/v3/users/e2c0ee165e3742cf98ea3b28b40b617d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:35.600284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:35.669984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:35.697058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c40b-4dad-4436-bc52-601c6416b425 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:35.731035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:35.731732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:35.732219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:35.732527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:35.799075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:35.800538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:35.867233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:35.897093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 596/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:39:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:39:35.903195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:35.967808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:36.001271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d043b-4a8e-4b8d-9064-6da8ee8664a2 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:36.033823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:36.034432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:36.034707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:36.034977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] PATH_INFO: `/v3/projects/0024d9492bb44201acb899867787b4e7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:36.036076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] RBAC: Authorizing `identity:get_project(project_id=0024d9492bb44201acb899867787b4e7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:36.037522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd60c54-823c-4c0f-bc74-78f2ca88ce81 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:36.039132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 603/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Aug 30 14:39:35 2022] GET /identity/v3/projects/0024d9492bb44201acb899867787b4e7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:36.045165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:39:36.141075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628f57-1fa6-46d3-bab2-0c8985f924ab None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:39:36.174625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:39:36.175211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:39:36.175491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:39:36.175766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:39:36.176481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=0024d9492bb44201acb899867787b4e7, user.id=e2c0ee165e3742cf98ea3b28b40b617d) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:39:36.176824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:39:36.178268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ff098-f6e4-466a-8ce0-d2618808bc4f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:39:36.183930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 597/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:39:36 2022] GET /identity/v3/role_assignments?user.id=e2c0ee165e3742cf98ea3b28b40b617d&scope.project.id=0024d9492bb44201acb899867787b4e7&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:39:46.029219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=32 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:46.181446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=82 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:48.563053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103f08-13f3-447b-a379-128e5260b2a3 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:48.563647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103f08-13f3-447b-a379-128e5260b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:48.563647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103f08-13f3-447b-a379-128e5260b2a3 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:48.565038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 604/1201] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:48.570111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:48.570548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:48.570651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:48.589359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:48.590656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:48.657279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 598/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:48.930276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae103f08-13f3-447b-a379-128e5260b2a3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.031422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae103f08-13f3-447b-a379-128e5260b2a3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.064581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.065229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.065511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.065783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.076113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.077581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:49.092438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:49.093694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:49.094699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:49.094699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:49.094699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:40:49.094699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 605/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:49.099646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.197914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2bb9-c5a0-4aef-8970-2b2cf70339b9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.226050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:49.232749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.233349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.233626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.233892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.234530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:49.234829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.236189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9cf7-8bf0-41b7-8c51-fa45d77ff723 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.247055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 599/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:49.253064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:49.305353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:49.350456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488216-a35f-403e-9a27-c37a3930b00a None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:49.382388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:49.382960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:49.383232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:49.383498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:49.384120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:49.385607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8b66-a83f-4a02-8ddc-d2edd95b56ff None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:49.535941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 606/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Aug 30 14:40:49 2022] POST /identity/v3/users => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:40:51.463788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12812c4-4650-402a-b573-cc055fb3c22e None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.464337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12812c4-4650-402a-b573-cc055fb3c22e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.464337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12812c4-4650-402a-b573-cc055fb3c22e None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.465858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 600/1206] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:51.471108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.471531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.471663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.490132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:51.491364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:51.557761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 607/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:51.830569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12812c4-4650-402a-b573-cc055fb3c22e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:51.931448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12812c4-4650-402a-b573-cc055fb3c22e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:51.965241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:51.966367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:51.966646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:51.966918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:51.977546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:51.983147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:51.984346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:51.985273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 601/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:51.990514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.034253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:52.092386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa207f-4a7a-4820-9b09-724801b231e8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.126217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.126816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.127094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.127365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.128019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:52.128319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.129717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.137677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 608/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:52.143472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.193369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:52.242043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a24c2-6171-4981-be74-62fffdc5429f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.273931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.274606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.274898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.275165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.287232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.288716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:52.304183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:52.305400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:52.306621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:52.306621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:52.306621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:52.308811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 602/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:52.311500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.407971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:52.410769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c856-d635-4111-bb90-4543bb66a7e8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.443314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.443997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.444295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.444567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.445298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:52.445597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.446944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.458456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 609/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:52.464123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.565719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff892e69-011c-41db-8068-9092b8847cba None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.567228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:52.599644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.600261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.600536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.600835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.608117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.609607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:52.620831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:52.622054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:52.623250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 603/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:52.627911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.727904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60d513-9786-41d9-ba56-f47f399d46e7 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.761011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.761598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.761872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.762817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.763828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:52.764131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.765580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:52.782370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 610/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:52.788149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:52.888730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa63a-fa2f-4fe5-b550-ca574034be9b None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:52.922627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:52.923216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:52.923498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:52.923768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:52.952293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:52.988729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:52.990173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.087276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 604/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:40:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:53.093841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:53.112721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:53.191587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cadbac-3981-40b0-9313-1ec948f69999 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:53.225812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:53.226419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.226693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.226959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.236624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:53.238075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:53.252227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:53.253375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:53.254654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:53.254654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:53.254654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:40:53.254654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 611/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:53.258905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:53.319623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:53.356257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f8b4c-c85a-4268-814b-4cf013c53022 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:53.389879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:53.390470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.390748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.391018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.391653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:53.391951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:53.393343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.404645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 605/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:53.410299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:53.479346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:53.509434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded82a-884a-4915-be8f-9cdea97f67aa None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:53.542851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:53.544157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.544437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.544735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.551511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:53.552965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:53.564014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:53.565143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:40:53.566497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 612/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:53.570957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:53.672405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a76e9-aa72-4255-a09e-b44912ec99b1 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:53.694258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:53.705538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:53.706131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.706411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.706682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.707373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:53.707678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:53.709146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e802a75-a2d5-4b5e-8db5-5559ca22254f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.721159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 606/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:53.727539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:53.826119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bc4d-c517-4de2-9c1b-bc4a1cf45ab4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:53.853826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:53.860022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:53.860612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:53.860921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:53.861191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:53.861904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f68cc82482a04e7a9ac920fd7da98e4f) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:53.862210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:53.863622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f6843-2a87-4ef8-959f-262232ab0562 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:53.868792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 613/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:40:53 2022] GET /identity/v3/role_assignments?user.id=f68cc82482a04e7a9ac920fd7da98e4f&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:55.741105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a1c9-1a30-469f-93af-8b9e3c1a3cc2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:55.741666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a1c9-1a30-469f-93af-8b9e3c1a3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:55.741666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a1c9-1a30-469f-93af-8b9e3c1a3cc2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:55.742976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 607/1220] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:55.748640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:55.751956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:55.751956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:55.767507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:55.768697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:55.835480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 614/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:40:56.102749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9a1c9-1a30-469f-93af-8b9e3c1a3cc2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.211085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9a1c9-1a30-469f-93af-8b9e3c1a3cc2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:56.245004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:56.245620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.245896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.246164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.256839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:40:56.261875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:56.262903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:56.263777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 608/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:56.269202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.365883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfb5a-39c7-4549-8c0b-82c7b961ebeb None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:56.388926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:56.399351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:56.399945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.400221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.400491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.401178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] RBAC: Adding query filter params (name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:56.401474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:56.402868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:56.410532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 615/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:56.416685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.461963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:56.517296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8de9c-b683-4ddc-b102-49faf089b207 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:56.549723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:56.550339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.550614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.556478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.560944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:56.562387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:56.577590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:56.578744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:56.579913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:56.579913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:56.579913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:56.579913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 609/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:56.584511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.685000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e159b1-6d7c-4eb5-a5d1-bf63eac769ac None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:56.717242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa48950-2571-413a-a710-864439701729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:56.717833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa48950-2571-413a-a710-864439701729 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.718112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa48950-2571-413a-a710-864439701729 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.718378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa48950-2571-413a-a710-864439701729 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.719010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa48950-2571-413a-a710-864439701729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:56.719308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa48950-2571-413a-a710-864439701729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:56.720695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa48950-2571-413a-a710-864439701729 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:56.731940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 616/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:56.737802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.832538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:56.839145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c4f55-870d-4b2b-864b-0a8bb8e6d501 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:56.872026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:56.872635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:56.872940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:56.873205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] PATH_INFO: `/v3/users/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:56.880470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:56.882361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:40:56.894524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:56.895636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:56.896951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 610/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:56.901798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa48950-2571-413a-a710-864439701729 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:56.948062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:56.999950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa48950-2571-413a-a710-864439701729 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.032867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.033458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.033731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.033996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.034716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:57.035017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.036425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.053695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 617/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:40:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:57.059849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.162994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75331ff0-15c9-4821-9411-3f31b5733afe None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.197112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.197728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.198036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.198326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.208605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.210079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:40:57.224715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:57.225880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:40:57.226792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:40:57.226792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:40:57.226792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:57.226792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 611/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:57.232730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.331348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9203d-c1c9-4435-ad8d-1b6fe60c37b3 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.333992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:57.367764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.368691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.369008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.369436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.370381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:57.370686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.372572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.383818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 618/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:40:57.390157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.404018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:57.494238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df634-657d-4454-aec4-28b3aad373aa None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.528100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.528748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.529024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.529288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.535807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.537339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:40:57.548545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:40:57.549468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:40:57.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 612/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:40:57.555692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.654435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ca26d-cd54-48d8-8452-1ddd32dce131 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.687887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.702637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.702908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.703169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.703849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:57.704147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.705583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd418b-8cb6-4416-80ec-08f6d5aca0b3 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.726306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 619/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:57.732994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:57.801068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:57.835370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34db0d-e81a-4e89-8e68-949052bde36c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:57.868226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:57.868895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:57.869175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:57.869445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f68cc82482a04e7a9ac920fd7da98e4f/roles/0aa7b62868344cbcaeeb07136e706519` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:57.883245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=f68cc82482a04e7a9ac920fd7da98e4f, role_id=0aa7b62868344cbcaeeb07136e706519)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:57.884992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c7fe0-63e7-4358-b628-749041346e10 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:57.980258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 613/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:40:57 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f68cc82482a04e7a9ac920fd7da98e4f/roles/0aa7b62868344cbcaeeb07136e706519 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:40:59.878130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a3b9c-1e93-4cd4-95da-efec99f35a8b None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:59.878678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a3b9c-1e93-4cd4-95da-efec99f35a8b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:59.878678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a3b9c-1e93-4cd4-95da-efec99f35a8b None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:59.879984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 620/1233] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:59.885024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:59.885412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:59.885579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:59.904768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:59.905951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:59.972084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 614/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:40:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:00.250597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a3b9c-1e93-4cd4-95da-efec99f35a8b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:00.276113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:00.352245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a3b9c-1e93-4cd4-95da-efec99f35a8b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:00.386679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:00.387437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:00.387709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:00.387968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:00.397850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:41:00.403429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:00.404415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:41:00.405311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:00.406003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 621/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Aug 30 14:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:00.410787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:00.458306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:00.510889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93feb-ba2d-4663-94f1-4e4c1ea73bf2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:00.545354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:00.545949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:00.546224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:00.546489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:00.547145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:00.547440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:00.548862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:00.556401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 615/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Aug 30 14:41:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:00.562192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:00.646451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:00.662524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4af6-66de-4026-a77c-f214503f5ceb None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:00.695002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:00.695951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:00.696224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:00.696489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:00.707296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:00.708864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:00.723907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:00.726869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:00.728011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:00.728011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:00.728011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:00.728011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 622/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:00.731127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:00.835672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9649f9-0953-44dc-9e3a-283f0812f8e8 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:00.845466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:00.869669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:00.870266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:00.870544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:00.870827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:00.871470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:00.871768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:00.873182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:00.884522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 616/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:00.890948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:00.991411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a144-dbc1-4c7b-8620-4c5085d202cb None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.025644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.026249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.026521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.026787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.029729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:01.034439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.035857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:41:01.047194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:01.048400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:01.049481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 623/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:01.054593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:01.155400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d5969-b39f-4fdc-98c5-210a59555cb7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.189338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.189944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.190224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.190501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.191228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:01.191533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.192997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.211360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 617/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:41:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:01.218217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:01.317735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adae3-8107-4a0a-9433-3acfd3795ab1 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.351299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.351891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.352162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.352426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.412996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:01.419548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.421016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.517369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 624/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:41:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:41:01.523645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:01.551113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:01.623026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1981491-0259-4b9c-b55c-6c359a6c7078 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.657018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.657625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.657899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.658163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.669270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.670794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:01.685600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:01.687168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:01.688407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:01.688407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:01.688407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:01.688407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 618/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:01.692482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:01.784889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:01.790450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626a59-f3e6-486e-ae19-8d339c86e1fa None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.823636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.824940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.825384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.825655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.826287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:01.826587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.827941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.838835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 625/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:01.844733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:01.921761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:01.943076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eccf16-544c-4b57-a0e0-d6b048238978 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:01.975700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:01.976317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:01.976679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:01.976959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:01.984405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:01.990073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:41:01.997722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:01.998783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:01.999757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 619/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:02.004878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:02.111312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7933e-1758-4ad7-b2ff-7cb9c674a871 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:02.145008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:02.145605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:02.145882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:02.146152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:02.146832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:02.147193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:02.148922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875731-88b5-4ace-a1a2-a9a3a23df316 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:02.161178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 626/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:02.167295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:02.269639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728449c8-10dd-4b25-88f4-49d1a97d157e None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:02.303503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:02.304096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:02.304406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:02.304697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:02.305424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] RBAC: Adding query filter params (role.id=0aa7b62868344cbcaeeb07136e706519, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f68cc82482a04e7a9ac920fd7da98e4f) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:02.305731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:02.307164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29543b8-3d76-4185-a2df-c57c1afaefdd None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:02.313633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 620/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:41:02 2022] GET /identity/v3/role_assignments?user.id=f68cc82482a04e7a9ac920fd7da98e4f&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=0aa7b62868344cbcaeeb07136e706519 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:04.304983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599391-f26c-40db-ba63-2d074f2711a3 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:04.305558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599391-f26c-40db-ba63-2d074f2711a3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:04.305558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599391-f26c-40db-ba63-2d074f2711a3 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:04.306833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 627/1247] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:04.312350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:04.312777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:04.312930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:04.319164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:04.331360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:04.332532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:04.397053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 621/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:04.665289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a599391-f26c-40db-ba63-2d074f2711a3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:04.684938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:04.767952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a599391-f26c-40db-ba63-2d074f2711a3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:04.802604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:04.803224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:04.803502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:04.803768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:04.813814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:41:04.818539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:04.819672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:04.820642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 628/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:04.826027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:04.924319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ba74-1baf-475c-8a57-350116ff599e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:04.953665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:04.958695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:04.959289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:04.959565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:04.959834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:04.960496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:04.960828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:04.962201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:04.970615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 622/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:04.976364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:05.054721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:05.076829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ad89-6cd5-4732-8c57-5928fd962e4f None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:05.110272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:05.110881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:05.111155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:05.111423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:05.121152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:05.123099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:05.137830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:05.139652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:05.141501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:05.141501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:05.141501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:05.141501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 629/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:05.144837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:05.245448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f91bf-f498-4587-85e4-98e769b6ab96 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:05.279506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:05.280104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:05.280380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:05.280649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:05.281319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:05.281620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:05.282989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:05.294657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 623/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:05.300428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:05.401055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e6eb-91c5-4fa4-a05e-93258630aaf6 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:05.426649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:05.434643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:05.435308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:05.435586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:05.435851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:05.442791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:05.444202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:41:05.455963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:05.457124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:05.458082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 630/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:05.463059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:05.519300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:05.562755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85b61d-8230-473e-bd20-bc114579ce9d None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:05.597369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:05.597961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:05.598235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:05.598514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:05.599216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:05.599515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:05.601008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:05.618037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 624/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:41:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:05.627596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:05.722459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b14ff-75f6-4da6-ae12-24ddf8190e65 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:05.755666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:05.756251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:05.756523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:05.756819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:05.811330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:05.823033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:05.825147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:05.923531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 631/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:41:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:41:05.929584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:06.029097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46baa0-9377-4d57-bb87-7f5a29f6fcbb None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:06.042037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:06.075229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:06.075229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:06.075229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:06.075229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:06.081729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:06.083170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:06.097609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:06.098770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:06.100131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:06.100131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:06.100131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:06.100131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 625/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:06.104491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:06.195359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:06.206833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766e9e-09fe-43bf-992b-5bf4d7898161 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:06.239896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:06.240478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:06.240787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:06.241055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:06.241790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:06.242091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:06.243427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:06.254705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 632/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:06.260839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:06.363980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca49d-cc0d-44b1-b24b-f9bb66ef6475 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:06.399477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:06.400115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:06.400400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:06.400680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:06.407714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:06.409202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:41:06.421548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:06.422635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:06.424007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 626/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:06.432434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:06.536637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba24e-0bf3-4a38-a4db-d0d3a2083c3e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:06.569360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:06.569952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:06.570224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:06.570490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:06.571162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:06.571457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:06.573251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf7bf-0fc8-4abb-bae7-01017f85956c None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:06.588113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 633/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:06.594378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:06.621409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:06.694885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69281d-ad9c-46e7-b803-e6e83063cbc0 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:06.727981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:06.728574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:06.728884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:06.729155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:06.729875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f68cc82482a04e7a9ac920fd7da98e4f) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:06.730706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:06.732217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e405-bd04-4cd8-a219-e798261896f5 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:06.737670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 627/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:41:06 2022] GET /identity/v3/role_assignments?user.id=f68cc82482a04e7a9ac920fd7da98e4f&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:08.606803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a01-3875-4c4b-8e5c-868539784eb6 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:08.607397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a01-3875-4c4b-8e5c-868539784eb6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:08.607397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a01-3875-4c4b-8e5c-868539784eb6 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:08.608677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 634/1261] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:08.613762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:08.614188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:08.614421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:08.632739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:08.635366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:08.699812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 628/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:08.970135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7a01-3875-4c4b-8e5c-868539784eb6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:08.981504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.074856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7a01-3875-4c4b-8e5c-868539784eb6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.108261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.108900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.109231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.109539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.119295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:41:09.125045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:09.127516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:09.128410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 635/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:09.132127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:09.151476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.232039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ed4a1-ef5c-4ead-900d-3b2c9a866127 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.265191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.265786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.266067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.266334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.266996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:09.267294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:09.268650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:09.276684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 629/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:09.282976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:09.349225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.382015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a300-3047-417e-abfd-9df391e5a953 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.415893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.416499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.416818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.417089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.428550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:09.430133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:09.444806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:09.446002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:09.447084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:09.447084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:09.447084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:09.447084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 636/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:09.451911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:09.532315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.551267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226ebdb-59e8-434c-8dfa-856633805498 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.584856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.585453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.585730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.585998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.586632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:09.586933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:09.588296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:09.600337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 630/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:09.606599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:09.705798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9686d8c-5920-4394-a636-59401ff5c7f4 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.726193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.739942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.741213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.741505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.741778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.749548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:09.754166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:41:09.762649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:09.763766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:09.765045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 637/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:41:09.769662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:09.872850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300d9a-35af-4f94-be49-0970c40f854c None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:09.907024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:09.907619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:09.907894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:09.908162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:09.908908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:09.909213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:09.910637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:09.919143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:09.927905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 631/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:09.933792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:10.033742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8028f8-c9ca-44b7-a21f-153ad6290395 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:10.066576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:10.067129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:10.067407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:10.067678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:10.079018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:10.080455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:10.094368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:10.095509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:10.096430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:10.096430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:10.096430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:10.096430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 638/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:10.101508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:10.205427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14b70-eaed-4207-92e5-81d1461c620f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:10.238043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:10.238635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:10.238909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:10.239173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:10.239879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:10.240174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:10.241569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:10.253394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 632/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:10.265273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:10.291431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:10.359973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77e68-ac8e-46bc-aa93-7e1e5226c36e None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:10.392943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:10.393549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:10.393820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:10.394082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:10.400840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:10.402386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:41:10.413200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:10.418942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:10.420026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 639/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:10.420718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:10.478804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:10.520884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210790-7d57-494f-bb69-f596945fe87f None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:10.556391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:10.557012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:10.557288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:10.557554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:10.559111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:10.559502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:10.560983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2bb4-fcaf-4f9b-81de-75c0e5864543 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:10.572519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 633/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:10.579059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:10.669041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:10.677315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31460300-0bc9-46f1-b69f-04de48a9b248 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:10.710331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:10.710992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:10.711232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:10.711519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] PATH_INFO: `/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f68cc82482a04e7a9ac920fd7da98e4f/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:10.713416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] RBAC: Authorizing `identity:create_grant(project_id=f410872d0c7b4ad59392be785ee1076b, user_id=f68cc82482a04e7a9ac920fd7da98e4f, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:10.715711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c87619-2132-4d53-945e-9e42c7928252 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:10.837307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 640/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Aug 30 14:41:10 2022] PUT /identity/v3/projects/f410872d0c7b4ad59392be785ee1076b/users/f68cc82482a04e7a9ac920fd7da98e4f/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:41:12.729023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf076-4495-4063-a2c6-a2b1772bdfb3 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:12.729557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf076-4495-4063-a2c6-a2b1772bdfb3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:12.729557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf076-4495-4063-a2c6-a2b1772bdfb3 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:12.730996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 634/1274] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:12.740673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:12.741112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:12.745222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:12.759428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:12.760598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:12.826816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 641/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:13.101628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caf076-4495-4063-a2c6-a2b1772bdfb3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.202727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caf076-4495-4063-a2c6-a2b1772bdfb3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:13.220037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:13.236475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:13.237121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:13.237398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:13.237671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:13.247605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:41:13.252568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:13.257088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:13.258152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 635/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:13.260240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.341254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:13.360488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13f9d-9c1f-41e4-9071-6b9e6f498f2f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:13.395438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:13.396357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:13.396703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:13.397235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:13.397899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:13.398198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:13.399610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:13.408339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 642/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:13.414305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.512846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344567-5fcb-4e3e-aba7-7f17a0f8a669 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:13.547833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:13.548458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:13.548771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:13.549046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:13.559350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:13.560841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:13.576035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:13.577219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:13.578156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:13.578156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:13.578156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:13.578156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 636/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:13.583168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.684336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979b32-cdc1-4629-834f-9a33899a6eaa None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:13.717566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:13.718149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:13.718421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:13.718684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:13.719308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:13.719604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:13.720982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:13.732670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 643/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:13.738424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.771100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:13.841215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623206b-d3a0-4aa0-a83b-f226b054bd29 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:13.874760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:13.875377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:13.875654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:13.875924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:13.883069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:13.884494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:41:13.896039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:13.897438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:13.898427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 637/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:13.903335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:13.907066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.002665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f57c5-57d5-4022-8c71-a4486266bd39 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.036181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.036804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.037084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:14.037355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:14.038070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:14.038369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:14.039784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:14.056450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 644/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Aug 30 14:41:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:14.062860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:14.154347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.163469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dc3e3-6166-4e05-bd14-5c8b95ccdcc2 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.197710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.198383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.198793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:14.199066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:14.265441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:14.266820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:14.352060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.362659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 638/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Aug 30 14:41:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:41:14.368437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:14.441683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.478962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db761ea9-4d8c-43b5-b3a6-9e91de9e0702 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.511229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.511841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.512114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:14.512377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:14.524730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:14.524730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:41:14.538937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:14.540043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:41:14.541075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:41:14.541075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:41:14.541075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:14.541075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 645/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:14.546403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:14.644298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db661-4812-42b9-8784-eaeaf81d9eee None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.679553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.680296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.680695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:14.681066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:14.681817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:14.682201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:14.683815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:14.695218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 639/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Aug 30 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:14.701202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:14.804384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805908-f5f5-41e4-bb2c-5d896e0d74d0 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.818267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.837743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.838358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.838632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:14.839450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:14.845955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:14.850745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:41:14.859159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:14.860064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: ERROR keystone.server.flask.application Aug 30 14:41:14.861057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 646/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Aug 30 14:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:14.866210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:14.916632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:14.966003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726255-daea-4e8b-8991-adfa3bfbe2a7 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:14.999092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:14.999682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:14.999957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:15.000227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:15.000942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:15.001246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:15.002673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2716f4-9478-4b74-ae6c-1a4796722b43 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:15.015816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 640/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Aug 30 14:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:15.022330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:15.128452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6ee8c-5c9e-45a6-9349-bdc2567d4701 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:15.162373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:15.162964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:15.163234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:15.163498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:15.164205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] RBAC: Adding query filter params (role.id=fa1cadcbfee74ff2bacf6eff22482dc6, scope.project.id=f410872d0c7b4ad59392be785ee1076b, user.id=f68cc82482a04e7a9ac920fd7da98e4f) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:15.164511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:15.165953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960a40d-e14f-4f8c-841c-42b543b5e809 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:15.171815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 647/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Aug 30 14:41:15 2022] GET /identity/v3/role_assignments?user.id=f68cc82482a04e7a9ac920fd7da98e4f&scope.project.id=f410872d0c7b4ad59392be785ee1076b&role.id=fa1cadcbfee74ff2bacf6eff22482dc6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:17.119656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35df9d5-9a11-429f-a54b-43a2924afd03 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:17.120198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35df9d5-9a11-429f-a54b-43a2924afd03 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:17.120198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35df9d5-9a11-429f-a54b-43a2924afd03 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:17.121934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 641/1288] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:17.127323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:17.127762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:17.127876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:17.146128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:17.147562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:17.177669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:17.213304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 648/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:41:17.481281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35df9d5-9a11-429f-a54b-43a2924afd03 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:17.582031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35df9d5-9a11-429f-a54b-43a2924afd03 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:17.593027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:17.615880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:17.616486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:17.616789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:17.617059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:17.617635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:17.619083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:17.627744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:17.633001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:17.634029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 642/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:41:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:17.634867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:17.733919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3561-f4de-45c6-ad68-e10512dd12ba None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:17.787670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:17.788277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:17.788555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:17.788860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:17.789509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:17.789807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:17.791177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33b70-9b3b-4cb9-a2f3-bd08ea666b1f None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:17.796642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 649/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 14:41:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:17.802425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:17.902177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93bb5-81e6-4d99-9ee7-6f91e6a53e64 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:17.934831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:17.935422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:17.935700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:17.935966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] PATH_INFO: `/v3/services` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:17.936589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:17.936918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:17.938279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622896b-d4ac-4c42-ba52-2349cbc62a60 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:17.942555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 643/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 14:41:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:19.854940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7473d-f213-42f7-8690-321fd14a4f1b None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:19.855456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7473d-f213-42f7-8690-321fd14a4f1b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:19.855547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7473d-f213-42f7-8690-321fd14a4f1b None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:19.856913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 650/1293] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:19.861928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634f17-99b9-4310-a557-20078ef5631f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:19.862351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634f17-99b9-4310-a557-20078ef5631f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:19.862454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634f17-99b9-4310-a557-20078ef5631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:19.881009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-af634f17-99b9-4310-a557-20078ef5631f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:19.882173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-af634f17-99b9-4310-a557-20078ef5631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:19.911642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:19.947715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 644/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:20.221636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7473d-f213-42f7-8690-321fd14a4f1b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:20.252739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:20.321752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7473d-f213-42f7-8690-321fd14a4f1b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:20.355961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:20.356543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:20.356849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:20.357115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:20.357756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:20.359095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01fb6f-6f2f-4a86-8d9d-b7488e6241ea None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:20.465801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 651/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Aug 30 14:41:20 2022] POST /identity/v3/services => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:41:22.393602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee565-62a4-4d12-8dda-18295a5266f2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:22.394169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee565-62a4-4d12-8dda-18295a5266f2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:22.394169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee565-62a4-4d12-8dda-18295a5266f2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:22.395487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 645/1296] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:41:22.401792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:22.402281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:22.402559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:22.420518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:22.421716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:22.492839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 652/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:22.766152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee565-62a4-4d12-8dda-18295a5266f2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:22.868446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee565-62a4-4d12-8dda-18295a5266f2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:22.902153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:22.902764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:22.903040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:22.903302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] PATH_INFO: `/v3/services/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:22.903870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:22.905258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:22.913985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:22.915172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:22.916248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 646/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:41:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:22.921843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:22.939819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:23.016649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6c511-5eff-41fa-91f9-2680f00147e1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:23.050675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:23.051274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:23.051551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:23.051821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:23.052442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:23.052778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:23.054145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:23.059184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 653/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 14:41:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:23.065247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:23.096748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:23.167790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9030a4-e34b-4810-9c6c-94f15500178a None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:23.201149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:23.201833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:23.202097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:23.202375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:23.203074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] RBAC: Adding query filter params (interface=public, service_id=197c1f27f54a490fad3071ad59bc9dfb, region_id=RegionOne) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:23.203376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:23.204839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1146-0265-4fe3-a93e-3751d56cae2e None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:23.209848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 647/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Aug 30 14:41:23 2022] GET /identity/v3/endpoints?service_id=197c1f27f54a490fad3071ad59bc9dfb&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:23.216426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:23.296578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:23.313608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3ae5-5376-44a2-baf7-149530c26ea8 None admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:23.347453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:23.348042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:23.348319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:23.348588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:23.349215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:23.350563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db488fe0-a087-4cf3-a2e1-a2ba7e4775ee None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:23.357281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 654/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Aug 30 14:41:23 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:41:25.270691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936ce-2990-49a1-b228-2b8ec51a5954 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:25.271222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936ce-2990-49a1-b228-2b8ec51a5954 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:25.271596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936ce-2990-49a1-b228-2b8ec51a5954 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:25.272977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 648/1302] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:25.278709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:25.279150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:25.279271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:25.297566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:25.309378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:25.363098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 655/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:41:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:41:25.632137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd936ce-2990-49a1-b228-2b8ec51a5954 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:25.726189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:25.733494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd936ce-2990-49a1-b228-2b8ec51a5954 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:25.765761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:25.766369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:25.766642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:25.766906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:25.767477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:25.768865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:41:25.778275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:41:25.782467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application with Lock( Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: ERROR keystone.server.flask.application Aug 30 14:41:25.783533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 649/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Aug 30 14:41:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:41:25.785369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:25.860175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:25.881840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66cdb-363e-4b23-9645-1ce90fd59528 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:25.915397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:25.915898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:25.917210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:25.917210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] PATH_INFO: `/v3/services` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:25.917617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:41:25.917914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:25.920751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fa2c8-1f05-4948-be22-b07acc653038 None admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:25.928220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 656/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Aug 30 14:41:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:25.934684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:26.035129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392a15-9c77-4743-bf9a-207fda60b198 None admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:26.068565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:26.069190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:26.069502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:26.069832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] PATH_INFO: `/v3/endpoints` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:26.070488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:26.071845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2a83c-d51b-4656-a19c-efb2bdf5b1af None admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:26.167735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 650/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:41:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:41:35.923486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=30 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:36.163128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:29.444360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2cf73-7cb8-4874-bf32-eaa0378ee832 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:29.445051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2cf73-7cb8-4874-bf32-eaa0378ee832 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:29.445381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2cf73-7cb8-4874-bf32-eaa0378ee832 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:29.447052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 657/1307] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:29.453192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548d2c9-bb18-4f9e-aa4c-a36a700ca6c3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:29.453640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548d2c9-bb18-4f9e-aa4c-a36a700ca6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:29.454015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548d2c9-bb18-4f9e-aa4c-a36a700ca6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:29.630264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-1548d2c9-bb18-4f9e-aa4c-a36a700ca6c3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:29.635690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1548d2c9-bb18-4f9e-aa4c-a36a700ca6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:29.876178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 651/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:30.187362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:30.187885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:30.188304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:30.190480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 658/1309] 10.222.0.13 () {54 vars in 965 bytes} [Tue Aug 30 14:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:30.198234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2201-e91a-4503-82b4-2139e606b9ce None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:30.198611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2201-e91a-4503-82b4-2139e606b9ce None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:30.198952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2201-e91a-4503-82b4-2139e606b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:30.294373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-412e2201-e91a-4503-82b4-2139e606b9ce None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:30.295846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-412e2201-e91a-4503-82b4-2139e606b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:30.319193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:30.390329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 652/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Tue Aug 30 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:30.399576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:30.401781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:30.538474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea181-fb52-4321-b9be-bf6c67e30fda None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:30.623607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:30.624213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:30.624494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:30.626725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:30.628535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:30.691809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:30.771847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:30.773789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d86c-9400-44d4-818c-dbf292faeff0 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:30.797871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 659/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:33.035491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.036006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.036006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.037329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 653/1312] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:33.042661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59526c8-0407-4a3e-a203-380634c8eb40 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.043080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59526c8-0407-4a3e-a203-380634c8eb40 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.043160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59526c8-0407-4a3e-a203-380634c8eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.124050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e59526c8-0407-4a3e-a203-380634c8eb40 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:33.125285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e59526c8-0407-4a3e-a203-380634c8eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.230643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 660/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:33.518461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:33.519964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.625978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686eaa-5a51-4749-8f79-6cea942bc1cb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:33.696387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:33.699126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:33.699727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:33.700009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:33.700282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:33.701926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:33.810758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:33.812393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f445-3f96-47c6-8e5c-364209f1a9b6 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:33.831296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 654/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:36.191153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.191661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.191661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.193005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 661/1315] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:36.198092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3f90-c3f5-4375-95e4-ec54e11dcacb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.198473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3f90-c3f5-4375-95e4-ec54e11dcacb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.198629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3f90-c3f5-4375-95e4-ec54e11dcacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.263785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c10a3f90-c3f5-4375-95e4-ec54e11dcacb None None] MFA Rules not processed for user `7f5962170c4a419c833982807cd8a0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:36.265006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c10a3f90-c3f5-4375-95e4-ec54e11dcacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.315930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.360718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 655/1316] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:36.644856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:36.646420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.656180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.750008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a0f9-fe2c-41ce-907c-751e3cb4a4b4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:36.824844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:36.825445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:36.825721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:36.825989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:36.827582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:36.890229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.940321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:36.941859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ee465-8e8f-4fca-bdf8-72e0fd5f2bf8 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:36.960284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 662/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:39.707907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:39.708435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:39.708435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:39.709831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 656/1318] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:39.716525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb06f-12d8-4f01-9676-d0416a42cf49 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:39.716974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb06f-12d8-4f01-9676-d0416a42cf49 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:39.717096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb06f-12d8-4f01-9676-d0416a42cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:39.782845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-697cb06f-12d8-4f01-9676-d0416a42cf49 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:39.784244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-697cb06f-12d8-4f01-9676-d0416a42cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:39.879499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 663/1319] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:40.171005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:40.172425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:40.277665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cb2e9-d993-446f-a336-0d306c32e2b2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:40.356722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:40.357633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:40.357920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:40.358193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:40.359801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:40.367285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:40.475844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:40.477333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c152d-94a3-4fd2-82a9-b2318bf7878c service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:40.496271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 657/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:43.382808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ae6e-e2b3-4c6a-8a9a-d26522bf4c7e None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.383383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ae6e-e2b3-4c6a-8a9a-d26522bf4c7e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.383383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865ae6e-e2b3-4c6a-8a9a-d26522bf4c7e None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.385155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 664/1321] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:43.390537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4a64-4fcf-4067-b4d9-48bd9785380d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.390968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4a64-4fcf-4067-b4d9-48bd9785380d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.391078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4a64-4fcf-4067-b4d9-48bd9785380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.458542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-de9e4a64-4fcf-4067-b4d9-48bd9785380d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:43.459751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-de9e4a64-4fcf-4067-b4d9-48bd9785380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:43.517864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:43.558449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 658/1322] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:43.858085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.858359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.858790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.860137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 665/1323] 10.222.0.13 () {54 vars in 965 bytes} [Tue Aug 30 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:43.866076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8e2-a4c3-4360-97d1-4146126fe593 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:43.866485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8e2-a4c3-4360-97d1-4146126fe593 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:43.866764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8e2-a4c3-4360-97d1-4146126fe593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:43.941954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a6a0a8e2-a4c3-4360-97d1-4146126fe593 None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:43.943152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a6a0a8e2-a4c3-4360-97d1-4146126fe593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:44.021196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 659/1324] 10.222.0.13 () {58 vars in 1062 bytes} [Tue Aug 30 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:44.030773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:44.032287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:44.051980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:44.137156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411cb26-dc18-4327-bdb8-e3632b873296 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:44.210307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:44.210903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:44.211180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:44.211450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:44.213657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:44.284381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:44.322046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:44.323528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff524ed-5ba8-4648-a604-6d39ee90c283 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:44.342340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 666/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:46.641840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:46.642431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:46.642431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:46.643767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 660/1326] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:46.649288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec32b-a89c-4af1-a5cb-39ad19e28b7d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:46.649759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec32b-a89c-4af1-a5cb-39ad19e28b7d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:46.649983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec32b-a89c-4af1-a5cb-39ad19e28b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:46.724155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-891ec32b-a89c-4af1-a5cb-39ad19e28b7d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:46.730423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-891ec32b-a89c-4af1-a5cb-39ad19e28b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:46.843004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 667/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:47.137532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:47.139163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:47.210875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:47.256258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80d0d4-c3c3-4a5c-b112-943b0aa6eafc None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:47.330035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:47.330645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:47.330922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:47.331189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:47.332822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:47.440857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:47.453108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:47.456929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216da3-ca2d-4804-93cd-1a9767513b0d service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:47.475893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 661/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:47:49.441659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:49.442202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:49.442202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:49.443534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 668/1329] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:49.449545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ccb5-9d8a-462a-9847-db7ef7a24af4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:49.450022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ccb5-9d8a-462a-9847-db7ef7a24af4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:49.450118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ccb5-9d8a-462a-9847-db7ef7a24af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:49.523266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-add1ccb5-9d8a-462a-9847-db7ef7a24af4 None None] MFA Rules not processed for user `7f5962170c4a419c833982807cd8a0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:49.524483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-add1ccb5-9d8a-462a-9847-db7ef7a24af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:49.630367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 662/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:49.929114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:49.930716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:49.963046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:50.044439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195058e-4278-4e6b-8660-8a06cee802e4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:50.122032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:50.122673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:50.122951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:50.123220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:50.124892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:50.206315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:50.240237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:50.241720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f48d7-0399-437c-bd09-4a39f9a4fa65 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:50.261372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 669/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:52.839000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:52.839523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:52.839523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:52.840904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 663/1332] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:52.846051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31d6-d5c1-4210-8942-a6342e21accb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:52.846453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31d6-d5c1-4210-8942-a6342e21accb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:52.846625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de31d6-d5c1-4210-8942-a6342e21accb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:53.029312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c3de31d6-d5c1-4210-8942-a6342e21accb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:53.030507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c3de31d6-d5c1-4210-8942-a6342e21accb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:53.124968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 670/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:53.407210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:53.409029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:53.477632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:53.511279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815330e-534a-4fdb-812b-8166d9a71e1d None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:53.584159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:53.584775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:53.585055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:53.585324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:53.586913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:53.692569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:53.693960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c6b31-3e07-4f69-96d0-0efdbf5ab907 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:53.704497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:53.713723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 664/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:55.797114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:55.797611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:55.797611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:55.799007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 671/1335] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:55.804344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd1c1-2278-4ab1-ad71-812553acc86e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:55.804836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd1c1-2278-4ab1-ad71-812553acc86e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:55.804936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd1c1-2278-4ab1-ad71-812553acc86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:55.873688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-929dd1c1-2278-4ab1-ad71-812553acc86e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:55.874908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-929dd1c1-2278-4ab1-ad71-812553acc86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:55.974528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 665/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:56.264975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:56.266527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:56.309703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:56.372380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0fb5-c109-4903-b9dc-afffbd0d39d5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:56.445440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:56.446040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:56.446315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:56.446583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:56.448205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:56.531948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:56.557424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:56.558898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd59759-90f2-483c-a5fd-7ee6076dcc42 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:56.578174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 672/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:59.225776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:59.226299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:59.226299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:59.227602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 666/1338] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:47:59.232715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfb7a5-5f69-435c-b1f6-edfd41d46628 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:59.233126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfb7a5-5f69-435c-b1f6-edfd41d46628 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:59.233262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfb7a5-5f69-435c-b1f6-edfd41d46628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:59.297865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-edbfb7a5-5f69-435c-b1f6-edfd41d46628 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:59.299054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-edbfb7a5-5f69-435c-b1f6-edfd41d46628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:59.393539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 673/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:59.675620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:59.677224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:59.754434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:59.783856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668365-7d65-430d-b047-55e1d9a89fc9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:59.861654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:59.862255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:59.862531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:59.862799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:59.864387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:59.973112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:59.974545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eacef8-c4b1-4bf4-a9ca-e8c1c12f3a33 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:59.993074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 667/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:04.074844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:04.075407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:04.075407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:04.076755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 674/1341] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:04.081948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2a0d-7240-4ff5-be1f-bfb9ba384d52 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:04.082378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2a0d-7240-4ff5-be1f-bfb9ba384d52 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:04.082519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2a0d-7240-4ff5-be1f-bfb9ba384d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:04.088312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:04.150313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-fa1b2a0d-7240-4ff5-be1f-bfb9ba384d52 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:04.151529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fa1b2a0d-7240-4ff5-be1f-bfb9ba384d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:04.250885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 668/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:04.532765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:04.534567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:04.584301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:04.639339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf19f7-f215-472d-89ee-6ed156c32fab None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:04.713089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:04.713759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:04.714036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:04.714289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:04.715912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:04.812722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:04.830201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:04.831641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0ae7-e331-41b4-9bf5-ace285a87db7 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:04.852324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 675/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:07.819387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:07.819890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:07.820042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:07.822164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 669/1344] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:07.827281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51614f4d-2555-4ff7-a463-3f212aa6d19e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:07.827722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51614f4d-2555-4ff7-a463-3f212aa6d19e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:07.827827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51614f4d-2555-4ff7-a463-3f212aa6d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:07.895990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-51614f4d-2555-4ff7-a463-3f212aa6d19e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:07.897127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-51614f4d-2555-4ff7-a463-3f212aa6d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:07.993721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 676/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:08.279435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:08.281067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.369023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:08.385562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f5a7e-3478-4977-a9d8-732d2ce6d172 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:08.462774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:08.463410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:08.463689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:08.463966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:08.465632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.582277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:08.583755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad962-92b1-4085-b1e6-d3948735589d service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:08.604599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 670/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:12.713922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:12.714508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:12.714508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:12.715819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 677/1347] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:12.721416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d533ba-5d59-4a54-8092-dc81022a3f6e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:12.721914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d533ba-5d59-4a54-8092-dc81022a3f6e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:12.722004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d533ba-5d59-4a54-8092-dc81022a3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:12.739624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:12.795044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-18d533ba-5d59-4a54-8092-dc81022a3f6e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:12.796704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-18d533ba-5d59-4a54-8092-dc81022a3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:12.901688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 671/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:13.183502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:13.185092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:13.241519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:13.287208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0477-a53a-498d-a8f6-eff8d07b3ee4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:13.360221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:13.360845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:13.361117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:13.361382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:13.362955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:13.466744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:13.470202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:13.471620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58fafd-69a5-4073-a00d-7e844af5064a service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:13.489666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 678/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:18.411543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31ffc-7fd7-4a7d-a993-a59daf90b93c None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:18.412170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31ffc-7fd7-4a7d-a993-a59daf90b93c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:18.412518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31ffc-7fd7-4a7d-a993-a59daf90b93c None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:18.415880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 672/1350] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:18.420110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ddc6f-3c1c-4342-b11c-08a48ce87017 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:18.421092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ddc6f-3c1c-4342-b11c-08a48ce87017 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:18.421431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ddc6f-3c1c-4342-b11c-08a48ce87017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:18.531052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-dc0ddc6f-3c1c-4342-b11c-08a48ce87017 None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:18.534591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-dc0ddc6f-3c1c-4342-b11c-08a48ce87017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:18.719044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 679/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:22.858310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3a1a-97be-4ed2-9caf-f8a6013acf44 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:22.858839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3a1a-97be-4ed2-9caf-f8a6013acf44 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:22.858839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3a1a-97be-4ed2-9caf-f8a6013acf44 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:22.860448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 673/1352] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:22.865266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0ca6-1a3d-4a98-946d-1fe76b787f7c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:22.865721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0ca6-1a3d-4a98-946d-1fe76b787f7c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:22.865994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d0ca6-1a3d-4a98-946d-1fe76b787f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:22.899627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=59 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:22.926012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:22.949849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c69d0ca6-1a3d-4a98-946d-1fe76b787f7c None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:22.951040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c69d0ca6-1a3d-4a98-946d-1fe76b787f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:23.063156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 680/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:24.559523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01328-aeff-4fed-8cef-a417d755906b None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:24.560056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01328-aeff-4fed-8cef-a417d755906b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:24.560151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01328-aeff-4fed-8cef-a417d755906b None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:24.561564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 674/1354] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:24.566798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc102-cf83-4f48-8734-1fa3a569a72e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:24.567267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc102-cf83-4f48-8734-1fa3a569a72e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:24.567353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc102-cf83-4f48-8734-1fa3a569a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:24.645717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-51dbc102-cf83-4f48-8734-1fa3a569a72e None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:24.646920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-51dbc102-cf83-4f48-8734-1fa3a569a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:24.689821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:24.756281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 681/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:28.093049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af42e-bb8f-444f-a19d-c4ba5645a1fc None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:28.093546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af42e-bb8f-444f-a19d-c4ba5645a1fc None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:28.093546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af42e-bb8f-444f-a19d-c4ba5645a1fc None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:28.094861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 675/1356] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:28.100010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d13-88fd-4461-906d-2a08d4232630 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:28.100458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d13-88fd-4461-906d-2a08d4232630 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:28.100547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d13-88fd-4461-906d-2a08d4232630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:28.175310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b3616d13-88fd-4461-906d-2a08d4232630 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:28.176479 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b3616d13-88fd-4461-906d-2a08d4232630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:28.318779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 682/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:28.617613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:28.618406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:28.618909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:28.620849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 676/1358] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 14:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:28.628979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5c4c-9a82-443b-8a6f-1e37a95634de None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:28.629649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5c4c-9a82-443b-8a6f-1e37a95634de None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:28.630120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf5c4c-9a82-443b-8a6f-1e37a95634de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:28.653056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:28.724276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9adf5c4c-9a82-443b-8a6f-1e37a95634de None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:28.725600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9adf5c4c-9a82-443b-8a6f-1e37a95634de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:28.860642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 683/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:28.868379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:28.870375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:29.030274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bedb6b-9270-430f-8904-4999190edb30 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:29.112239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:29.155508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:29.156500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:29.157047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:29.157528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:29.159586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:29.255278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:29.257287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b4783-2eca-493a-afb8-c03f666e5468 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:29.277244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 677/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:31.475158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:31.475708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:31.475965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:31.478442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 684/1361] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:31.485045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef920c-891f-41a9-bea2-a19201fa50f0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:31.485576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef920c-891f-41a9-bea2-a19201fa50f0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:31.485815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef920c-891f-41a9-bea2-a19201fa50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:31.557878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-20ef920c-891f-41a9-bea2-a19201fa50f0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:31.559277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-20ef920c-891f-41a9-bea2-a19201fa50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:31.600465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:31.663655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 678/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:31.970350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:31.971907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:32.064851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:32.157267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6a33-e1d4-4fa8-990b-1312ad23a080 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:32.277077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:32.277948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:32.278378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:32.278829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:32.281016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:32.306624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:32.381643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:32.383542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b866-bd0d-4b5b-8324-d6e75d38a581 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:32.406214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 685/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:34.785133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e9cc-313a-40e0-a5de-99fc8ee4837d None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:34.786028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e9cc-313a-40e0-a5de-99fc8ee4837d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:34.786309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e9cc-313a-40e0-a5de-99fc8ee4837d None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:34.787666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 679/1364] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:34.793982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03418-deb8-4a84-a76b-72cbe184f649 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:34.794452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03418-deb8-4a84-a76b-72cbe184f649 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:34.794928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03418-deb8-4a84-a76b-72cbe184f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:34.870207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-17a03418-deb8-4a84-a76b-72cbe184f649 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:34.871562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-17a03418-deb8-4a84-a76b-72cbe184f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:34.972958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:34.975927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 686/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:35.270480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:35.270909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:35.271279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:35.272989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 680/1366] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 14:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:35.279060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fb87-833f-4ec7-b9b4-208a45819070 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:35.279345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fb87-833f-4ec7-b9b4-208a45819070 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:35.280333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fb87-833f-4ec7-b9b4-208a45819070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:35.361811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4855fb87-833f-4ec7-b9b4-208a45819070 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:35.363013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4855fb87-833f-4ec7-b9b4-208a45819070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:35.487909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 687/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:35.496322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:35.498074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:35.657266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61194-8183-471b-9649-fdb69b1a18b2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:35.682016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:35.780700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:35.781460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:35.781856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:35.782224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:35.784183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:35.888034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:35.889604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a26047-147d-414a-bbd6-f41aaacbd8d9 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:35.908268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 681/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:36.460041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc270a1-21a7-44ba-95af-f9cc95d53da2 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:36.460548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc270a1-21a7-44ba-95af-f9cc95d53da2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:36.460548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc270a1-21a7-44ba-95af-f9cc95d53da2 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:36.462109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 688/1369] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:36.467467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351e90-b233-4d5a-a09d-540c3996b1dd None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:36.467880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351e90-b233-4d5a-a09d-540c3996b1dd None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:36.468251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351e90-b233-4d5a-a09d-540c3996b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:36.502273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:36.541353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ca351e90-b233-4d5a-a09d-540c3996b1dd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:36.542842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ca351e90-b233-4d5a-a09d-540c3996b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:36.649814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 682/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:37.236179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:37.236179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:37.236179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:37.237940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 689/1371] 10.222.0.13 () {54 vars in 964 bytes} [Tue Aug 30 14:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:37.242375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8619d2-990e-493d-a3a8-a282111403f6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:37.243151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8619d2-990e-493d-a3a8-a282111403f6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:37.243151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8619d2-990e-493d-a3a8-a282111403f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:37.322494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ae8619d2-990e-493d-a3a8-a282111403f6 None None] MFA Rules not processed for user `136f5fbf04ab4000b0c80f1955f6515b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:37.323688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ae8619d2-990e-493d-a3a8-a282111403f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:37.371121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:37.402811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 683/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Aug 30 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:37.410708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:37.412350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:37.466139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:37.525965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561ac08-b9d9-4118-96e6-1a58b548b52c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:37.608949 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:37.609557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:37.609828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:37.610092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:37.611703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:37.715194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:37.731752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:37.733236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33428bf0-6ac2-4134-a133-b72d92efb4c5 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:37.754251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 690/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:38.066391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:38.066701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:38.067026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:38.068379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 684/1374] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:38.073702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fbac-8941-4c85-bbfa-4520c2a8401e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:38.073988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fbac-8941-4c85-bbfa-4520c2a8401e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:38.074261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fbac-8941-4c85-bbfa-4520c2a8401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:38.142803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-43f5fbac-8941-4c85-bbfa-4520c2a8401e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:38.144002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-43f5fbac-8941-4c85-bbfa-4520c2a8401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:38.239701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 691/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:38.530417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:38.531930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:38.683360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5f36-d313-4384-911a-1da00eeb1b57 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:38.737333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:38.800168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:38.800711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:38.801045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:38.801252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:38.802843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:38.898561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:38.900222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718a19f-8a42-4f4b-88a5-3cb9063f8d48 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:38.918148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 685/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:41.002055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.002601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.002601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.004187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 692/1377] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:41.009698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ea45-b066-4afe-856a-05e5cefebcbd None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.010151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ea45-b066-4afe-856a-05e5cefebcbd None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.010293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ea45-b066-4afe-856a-05e5cefebcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.089548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2270ea45-b066-4afe-856a-05e5cefebcbd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:41.090651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2270ea45-b066-4afe-856a-05e5cefebcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:41.097354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:41.194008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 686/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:41.497423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:41.498599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:41.586551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:41.688864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747d70-b8a9-431d-8d19-6a4f1828e6ce None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:41.825267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:41.826153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:41.826890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:41.827328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:41.829249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:41.859071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:42.002890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:42.002890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb4f83-05b3-42c3-a61c-8806df38624e service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:42.002890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 693/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:44.187731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:44.188310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:44.188310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:44.189784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 687/1380] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:44.194997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46296-d69e-4c06-b245-08b3eb01222f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:44.195644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46296-d69e-4c06-b245-08b3eb01222f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:44.195644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46296-d69e-4c06-b245-08b3eb01222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:44.266704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6ee46296-d69e-4c06-b245-08b3eb01222f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:44.267942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6ee46296-d69e-4c06-b245-08b3eb01222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:44.377491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:44.392797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 694/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:44.702069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:44.703760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:44.865293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:44.878097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ab26-b802-450c-9a8a-0b2df6e13226 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:45.012068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:45.012793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:45.013135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:45.013469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:45.015116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:45.109190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:45.110777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c96100-e9b6-478b-954e-b13570245f67 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:45.122235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:45.130654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 688/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:47.275627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:47.276190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:47.276303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:47.278113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 695/1383] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:47.283806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b97c6-dc71-4141-aaf6-bc99c5cc01f5 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:47.284353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b97c6-dc71-4141-aaf6-bc99c5cc01f5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:47.284353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b97c6-dc71-4141-aaf6-bc99c5cc01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:47.369869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-112b97c6-dc71-4141-aaf6-bc99c5cc01f5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:47.371775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-112b97c6-dc71-4141-aaf6-bc99c5cc01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:47.481879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 689/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:47.785361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:47.787356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:47.989249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048e0bb-ef7d-4360-be38-d48fe6917c93 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:48.091676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:48.167862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:48.168900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:48.169274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:48.169657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:48.172014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:48.298375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:48.302764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439f24f-4ab6-4029-8cad-8cfa5e63a0a8 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:48.333237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 696/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:50.371264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:50.371805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:50.371937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:50.373320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 690/1386] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:50.379678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749dd-0e18-4c7b-860c-5c08c623fcc6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:50.380102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749dd-0e18-4c7b-860c-5c08c623fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:50.380256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749dd-0e18-4c7b-860c-5c08c623fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:50.450394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-722749dd-0e18-4c7b-860c-5c08c623fcc6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:50.451581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-722749dd-0e18-4c7b-860c-5c08c623fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:50.488334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:50.564271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 697/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:50.927688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:50.929923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:51.009851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:51.097987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e21e-a278-4c09-9ca2-7094f3f7b02c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:51.228806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:51.229406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:51.229668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:51.229940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:51.231565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:51.275036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:51.332061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:51.334041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04148196-5cb0-420c-b3d4-ded07c44cb88 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:51.357466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 691/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:53.452785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21803-f970-4a2d-92f3-1f0056fe65b4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:53.453362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21803-f970-4a2d-92f3-1f0056fe65b4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:53.453362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21803-f970-4a2d-92f3-1f0056fe65b4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:53.454647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 698/1389] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:53.459694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:53.460099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:53.460813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:53.527175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:53.528367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:53.586514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e020f-db20-445d-8849-e9344b1e3deb None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:53.586794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e020f-db20-445d-8849-e9344b1e3deb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:53.587060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e020f-db20-445d-8849-e9344b1e3deb None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:53.588390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 699/1390] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:53.593399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfda4d9-0b51-4f93-9771-db9cb060cc49 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:53.593673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfda4d9-0b51-4f93-9771-db9cb060cc49 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:53.593940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfda4d9-0b51-4f93-9771-db9cb060cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:53.627817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 692/1391] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:53.660866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3dfda4d9-0b51-4f93-9771-db9cb060cc49 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:53.662074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3dfda4d9-0b51-4f93-9771-db9cb060cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:53.760433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 700/1392] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:53.924374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:53.925610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:53.940298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:54.043243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf9ee-e8ed-4e2a-8c36-fa91c561a120 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:54.063964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad159-1c02-4b24-a93b-edd782615268 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:54.064243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad159-1c02-4b24-a93b-edd782615268 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:54.064511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad159-1c02-4b24-a93b-edd782615268 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:54.065893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 701/1393] 10.222.0.13 () {54 vars in 967 bytes} [Tue Aug 30 14:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:48:54.071333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:54.071614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:54.071884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:54.088807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:54.150035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] MFA Rules not processed for user `f8125d6e3bd74258be79e477260a977b`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:54.151244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:54.159968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:54.160705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:54.160992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:54.161252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:54.162880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:54.172063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:54.230096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 702/1394] 10.222.0.13 () {58 vars in 1064 bytes} [Tue Aug 30 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:54.237589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:54.245458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2d77-5a29-4ba1-bb9a-9282a77e9faf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:54.259321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:54.261328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6893bb-39f9-408d-a0ac-433904c55708 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:54.280701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 693/1395] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:54.324317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:54.324317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:54.324535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:54.324837 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:54.326458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:54.357639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:54.437454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:54.438953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8e282-fbb6-494b-aedf-99680c5d00c0 service glance] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:54.458071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 703/1396] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:55.373653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b357-b38e-4994-a504-ecd55cba2c5d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:55.374131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b357-b38e-4994-a504-ecd55cba2c5d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:55.374323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b357-b38e-4994-a504-ecd55cba2c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:55.442611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9801b357-b38e-4994-a504-ecd55cba2c5d None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:55.443820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9801b357-b38e-4994-a504-ecd55cba2c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:55.526889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:55.530567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 694/1397] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:55.577903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:55.578367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:55.580243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:55.581814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 704/1398] 10.222.0.13 () {54 vars in 943 bytes} [Tue Aug 30 14:48:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:55.589833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19530-118a-41b4-8140-fae55c328176 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:55.590124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19530-118a-41b4-8140-fae55c328176 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:55.590395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19530-118a-41b4-8140-fae55c328176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:55.666639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-70b19530-118a-41b4-8140-fae55c328176 None None] MFA Rules not processed for user `285d5d20968a4dfe9c764fd09cc4ed4b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:55.667846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-70b19530-118a-41b4-8140-fae55c328176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:55.777716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 695/1399] 10.222.0.13 () {58 vars in 1040 bytes} [Tue Aug 30 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:55.787101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:55.788992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:55.924820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:55.927386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f081d1-b76d-4891-bf6e-04a4b4e16e1a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:56.033195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:56.034086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:56.034389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:56.034760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:56.036413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:56.122476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:56.124064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0ba2-2d80-4f65-9e61-0f3dc52baf32 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:56.132709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 705/1400] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:48:56.384698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:56.385310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:56.385310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:56.386664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 696/1401] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:48:56.392526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d516-87b4-4540-99d5-2884d68f7ddd None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:56.392891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d516-87b4-4540-99d5-2884d68f7ddd None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:56.393172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d516-87b4-4540-99d5-2884d68f7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:56.432231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:56.461812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3d34d516-87b4-4540-99d5-2884d68f7ddd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:56.463015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3d34d516-87b4-4540-99d5-2884d68f7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:56.572116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 706/1402] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:56.903726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:56.905306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:56.975534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:57.076929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434a23-3a8f-4c06-87c9-7606d835a579 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:57.207239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:57.208945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:57.209234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:57.209510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:57.212034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:57.232588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:57.312224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:57.314026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe0330-96bf-4b82-99da-c58cd50919b8 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:57.334475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 697/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:00.068977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:00.070165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:00.070444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:00.072061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 707/1404] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:00.078968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e50-a995-4d40-b82d-c42b4cda42d6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:00.078968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e50-a995-4d40-b82d-c42b4cda42d6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:00.078968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e50-a995-4d40-b82d-c42b4cda42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:00.151009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e4279e50-a995-4d40-b82d-c42b4cda42d6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:00.152831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e4279e50-a995-4d40-b82d-c42b4cda42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:00.265689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:00.272926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 698/1405] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:00.571987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:00.573589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:00.687893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:00.736327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455682-24b0-416e-933f-95caa1141db9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:00.870267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:00.870805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:00.871078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:00.871342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:00.872971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:00.954743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:00.979467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:00.981112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe671cf-69f5-496b-935c-14277ba271fa service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:01.002107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 708/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:03.157464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:03.158098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:03.158098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:03.159669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 699/1407] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:03.165891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b90e1-f244-4e0c-b50a-98c5c012ca5c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:03.166392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b90e1-f244-4e0c-b50a-98c5c012ca5c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:03.166486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b90e1-f244-4e0c-b50a-98c5c012ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:03.244813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3c0b90e1-f244-4e0c-b50a-98c5c012ca5c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:03.246195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3c0b90e1-f244-4e0c-b50a-98c5c012ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:03.381734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 709/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:03.718740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:03.720298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:03.918696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4199-fa3e-4a53-b5bb-c35b1876f6af None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:03.995957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:04.048987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:04.049580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:04.049854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:04.050119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:04.051706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:04.148073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:04.149753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cf28-8c30-4146-bc3f-122a7943edbe service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:04.169110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 700/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:13.379432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=79 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:14.166718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=64 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:19.947527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404472-e1f5-4010-91ef-418f1b6f779d None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:19.948087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404472-e1f5-4010-91ef-418f1b6f779d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:19.948087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404472-e1f5-4010-91ef-418f1b6f779d None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:19.949364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 710/1410] 10.222.0.13 () {54 vars in 918 bytes} [Tue Aug 30 14:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:19.954344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7f2f-a495-49ec-a527-edfc545e74b3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:19.954790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7f2f-a495-49ec-a527-edfc545e74b3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:19.954888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd7f2f-a495-49ec-a527-edfc545e74b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:20.029235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d2bd7f2f-a495-49ec-a527-edfc545e74b3 None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:20.031330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d2bd7f2f-a495-49ec-a527-edfc545e74b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:20.142746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 701/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Aug 30 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:20.157512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591762f5-7e68-4067-9c91-1c5a11f61afe None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:20.157824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591762f5-7e68-4067-9c91-1c5a11f61afe None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:20.158103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591762f5-7e68-4067-9c91-1c5a11f61afe None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:20.159734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 711/1412] 10.222.0.13 () {54 vars in 918 bytes} [Tue Aug 30 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:20.164573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc046-892b-4ed8-81a3-b7c584e45365 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:20.164883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc046-892b-4ed8-81a3-b7c584e45365 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:20.165157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc046-892b-4ed8-81a3-b7c584e45365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:20.238721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:20.242423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ad6dc046-892b-4ed8-81a3-b7c584e45365 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:20.243584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ad6dc046-892b-4ed8-81a3-b7c584e45365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:20.361645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 702/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Aug 30 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:22.748417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:22.748965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:22.749111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:22.750334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:22.755566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557603e-e4f8-4909-80bf-629b0b0e8e76 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:22.756004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557603e-e4f8-4909-80bf-629b0b0e8e76 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:22.756103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557603e-e4f8-4909-80bf-629b0b0e8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:22.824457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b557603e-e4f8-4909-80bf-629b0b0e8e76 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:22.825731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b557603e-e4f8-4909-80bf-629b0b0e8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:22.880576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:22.923876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:23.209579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:23.212081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:23.356487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6553-2f30-4f50-a177-fccdf06996e8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:23.427892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:23.468196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:23.468721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:23.468997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:23.469266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:23.470845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:23.558148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:23.560047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca9d10-1ca7-4c77-b658-f082b864af16 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:23.579004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 713/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:24.484075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:24.484647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:24.484647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:24.485998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:24.491083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cbf8-222b-40cc-b24f-94ba8e0bc62c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:24.492043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cbf8-222b-40cc-b24f-94ba8e0bc62c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:24.492305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cbf8-222b-40cc-b24f-94ba8e0bc62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:24.566495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9d19cbf8-222b-40cc-b24f-94ba8e0bc62c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:24.567599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9d19cbf8-222b-40cc-b24f-94ba8e0bc62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:24.595212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:24.666334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:24.819584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:24.821079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:24.967329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bf1e-f1dd-4fbe-b35d-38d5a982fc65 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:25.007844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:25.082259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:25.082776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:25.083055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:25.083325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:25.084970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:25.174477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:25.176084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0dc6-b5cc-464a-b970-f3776dcfc041 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:25.195051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 705/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:26.079346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:26.079991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:26.079991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:26.081289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:26.086989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2508a1-e0ab-451e-a197-0df850e6c7c6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:26.087459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2508a1-e0ab-451e-a197-0df850e6c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:26.087568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2508a1-e0ab-451e-a197-0df850e6c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:26.141879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:26.164255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-fb2508a1-e0ab-451e-a197-0df850e6c7c6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:26.165503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fb2508a1-e0ab-451e-a197-0df850e6c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:26.261402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:26.414091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:26.415651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:26.559279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c3ea-e702-4b92-8e05-5860df4af63c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:26.571868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:26.673054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:26.673566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:26.673836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:26.674100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:26.675677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:26.764829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:26.766423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3bcc9-9cbc-4690-929f-fee2775f2903 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:26.785425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 716/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:27.644446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018434f-697b-4928-85c3-88355bbee854 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:27.644929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018434f-697b-4928-85c3-88355bbee854 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:27.645024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018434f-697b-4928-85c3-88355bbee854 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:27.646419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:27.651792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2151a-5f6e-41fc-b288-df5a9775fbff None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:27.652228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2151a-5f6e-41fc-b288-df5a9775fbff None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:27.652333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2151a-5f6e-41fc-b288-df5a9775fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:27.672583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:27.729566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-78b2151a-5f6e-41fc-b288-df5a9775fbff None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:27.730818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-78b2151a-5f6e-41fc-b288-df5a9775fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:27.829053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:28.010175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018434f-697b-4928-85c3-88355bbee854 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:28.011763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7018434f-697b-4928-85c3-88355bbee854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.125418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:28.163150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018434f-697b-4928-85c3-88355bbee854 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:28.279299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:28.279812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:28.280090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:28.280360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:28.281990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.361366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:28.375198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:28.376830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803124e-4243-4ab2-b8a9-d4d7129ced29 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:28.395043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 708/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:29.275196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:29.275758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:29.275758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:29.277174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:29.281964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed44d-f875-4f53-9581-f7264665c363 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:29.282422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed44d-f875-4f53-9581-f7264665c363 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:29.282547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed44d-f875-4f53-9581-f7264665c363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:29.358533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4d0ed44d-f875-4f53-9581-f7264665c363 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:29.359720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4d0ed44d-f875-4f53-9581-f7264665c363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:29.455426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:29.604551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:29.606102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:29.690053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:29.751906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355aa60-d5d4-4702-b1b0-b53f1a7a758a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:29.869558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:29.870085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:29.870355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:29.870618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:29.872197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:29.919931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:29.961334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:29.962918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a995-f322-4185-a8fc-1c50327ea4b6 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:29.980643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 719/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:30.903062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:30.903651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:30.903651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:30.904970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:30.910069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d01c-67a2-4849-a206-9f08d0759082 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:30.910482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d01c-67a2-4849-a206-9f08d0759082 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:30.910620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d01c-67a2-4849-a206-9f08d0759082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:30.985316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b4c7d01c-67a2-4849-a206-9f08d0759082 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:30.986518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b4c7d01c-67a2-4849-a206-9f08d0759082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.082307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:31.234468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:31.235991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.284227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:31.383928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523e1c5-753d-4dc7-9113-f983b9880877 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:31.497352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:31.497943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:31.498216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:31.498478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:31.500060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:31.506815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:31.591165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:31.592787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2578-2839-45bc-befa-00a066c52d13 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:31.611271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 711/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:32.503849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:32.504444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:32.504444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:32.505744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:32.511058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834771-e624-4b43-b7bc-41a45232d6ba None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:32.511482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834771-e624-4b43-b7bc-41a45232d6ba None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:32.511632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834771-e624-4b43-b7bc-41a45232d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:32.587391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ad834771-e624-4b43-b7bc-41a45232d6ba None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:32.588598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ad834771-e624-4b43-b7bc-41a45232d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:32.656498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:32.684957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:32.837797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:32.839326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:32.858282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:32.993798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa724f-e402-4166-b309-96b3f7a4604b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:33.081021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:33.106976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:33.107576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:33.107853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:33.108123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:33.109748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:33.198194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:33.199774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37f55-502c-4452-b1ab-5a065865083c service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:33.218637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 722/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:34.064330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.064927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.064927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.066246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:34.071612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d697ae-763b-4b24-a07c-349f82f020ef None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.072128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d697ae-763b-4b24-a07c-349f82f020ef None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.072128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d697ae-763b-4b24-a07c-349f82f020ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.146301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-39d697ae-763b-4b24-a07c-349f82f020ef None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:34.147508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-39d697ae-763b-4b24-a07c-349f82f020ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.190824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:34.246664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:34.415214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:34.416740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.562788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10bdd-912f-44f4-aa5c-2852aa3ec9c8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:34.615896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:34.674068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:34.674580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.674861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.675130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.676779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.769304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:34.770923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3861b-6f26-4653-88b4-46b2a0b69568 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:34.790101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 714/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:35.649370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.649888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.649888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.651236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:35.656174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcfbd-e299-433d-8318-572d1e2b440f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.656591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcfbd-e299-433d-8318-572d1e2b440f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.656759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bcfbd-e299-433d-8318-572d1e2b440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.732609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-888bcfbd-e299-433d-8318-572d1e2b440f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:35.746060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-888bcfbd-e299-433d-8318-572d1e2b440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:35.746060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:35.832860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:35.982655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.984078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.128685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328873-3700-4b13-82d2-d769e102b75c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:36.155221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.243416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:36.244015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:36.244291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:36.244561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:36.246222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.336497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:36.338114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2553a-142c-4f24-afe6-5ce5d81460c2 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:36.355835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 725/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:38.177692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:38.178258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:38.178258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:38.179906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:38.185210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc55c9-8e7e-4357-b00a-b91e7d1a9885 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:38.185667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc55c9-8e7e-4357-b00a-b91e7d1a9885 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:38.185778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc55c9-8e7e-4357-b00a-b91e7d1a9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:38.227065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:38.251144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b9fc55c9-8e7e-4357-b00a-b91e7d1a9885 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:38.252328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b9fc55c9-8e7e-4357-b00a-b91e7d1a9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:38.349342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:38.637404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:38.639382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:38.744601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7d1c-1164-4dc2-b2f0-7f2a43488f02 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:38.775918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:38.819714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:38.820317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:38.820591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:38.820887 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:38.822497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:38.932913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:38.934345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afd21d-13a0-4c50-9cdf-6a184d7f3325 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:38.952362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 717/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:41.012043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:41.012614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:41.012614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.014048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:41.019180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f00b-4474-41b8-8aab-9f2471481944 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:41.019559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f00b-4474-41b8-8aab-9f2471481944 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:41.019733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f00b-4474-41b8-8aab-9f2471481944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.085724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3312f00b-4474-41b8-8aab-9f2471481944 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:41.086842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3312f00b-4474-41b8-8aab-9f2471481944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.099305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:41.183406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:41.477262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:41.478807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.580882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193662-f3f1-40ce-b20e-b5359ec674b2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:41.592810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:41.654435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:41.655106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:41.655382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:41.655754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.657394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.765062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:41.766486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2359278-ff0b-468d-9a99-a53ffab269e1 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:41.785023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 728/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:44.095014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:44.095584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:44.095584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:44.096942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:44.102517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad5fe-417d-459a-a3df-f68292674910 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:44.102920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad5fe-417d-459a-a3df-f68292674910 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:44.103056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad5fe-417d-459a-a3df-f68292674910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:44.151088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:44.169095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-960ad5fe-417d-459a-a3df-f68292674910 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:44.170307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-960ad5fe-417d-459a-a3df-f68292674910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:44.269965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:44.556114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:44.557660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:44.662268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4407e-8e17-4ec6-b6ad-ad3de8968dd6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:44.702540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:44.736855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:44.737450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:44.737726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:44.737990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:44.740403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:44.853585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:44.855024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6a63b-3a77-435d-8bdc-95561522bc86 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:44.874633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 720/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:46.914375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:46.914957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:46.914957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:46.916250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:46.921746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870cda-4e79-4943-9d52-2e46ddaa4905 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:46.922165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870cda-4e79-4943-9d52-2e46ddaa4905 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:46.922272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff870cda-4e79-4943-9d52-2e46ddaa4905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:46.986236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ff870cda-4e79-4943-9d52-2e46ddaa4905 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:46.987415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ff870cda-4e79-4943-9d52-2e46ddaa4905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:47.008344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:47.085516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:47.375295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:47.376869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:47.495389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ccf0-54da-4062-89d8-c97e7a058e13 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:47.514795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:47.568151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:47.568765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:47.569070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:47.569448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:47.571206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:47.679576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:47.681102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5efaa-92bd-472a-a7b2-12ea51d5caa3 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:47.700168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 731/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:49.699333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.699874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.699874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.701285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:49.707025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e1a3-058e-4747-bf6b-103eaaed6f6e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.707511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e1a3-058e-4747-bf6b-103eaaed6f6e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.707612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e1a3-058e-4747-bf6b-103eaaed6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.792396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:49.799720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7060e1a3-058e-4747-bf6b-103eaaed6f6e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:49.800994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7060e1a3-058e-4747-bf6b-103eaaed6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.917497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:50.284505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:50.286088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:50.393711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dedf8-8a82-4190-a583-6510e3a2d907 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:50.442463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:50.467606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:50.468210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:50.468489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:50.468788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:50.470393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:50.579115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:50.580509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e29d1a-fd08-4cd6-8bca-9e796ce9148a service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:50.598719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 723/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:52.690840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.691391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.691391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.692727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:52.698584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff3069-4505-4aca-8078-95fa6c7a49d0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.698971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff3069-4505-4aca-8078-95fa6c7a49d0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.699133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff3069-4505-4aca-8078-95fa6c7a49d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.765465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b3ff3069-4505-4aca-8078-95fa6c7a49d0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:52.766664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b3ff3069-4505-4aca-8078-95fa6c7a49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:52.795755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:52.864022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:53.146499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:53.148734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:53.251659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56be8-55d2-42af-b3c4-8a39dfd53be2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:53.279573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:53.324652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:53.325275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:53.325552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:53.325818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:53.327392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:53.433060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:53.434449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db28b-05f1-44f9-93ec-4f0cfac00661 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:53.453214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 734/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:55.426778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.427324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.427423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.429257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:55.434698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175f2f8-b716-4f38-9049-721da8413722 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.435154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175f2f8-b716-4f38-9049-721da8413722 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.435293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175f2f8-b716-4f38-9049-721da8413722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.501058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0175f2f8-b716-4f38-9049-721da8413722 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:55.502273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0175f2f8-b716-4f38-9049-721da8413722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:55.511024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:55.598690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:55.883177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:55.884735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:55.986089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595a7a-0632-4e65-8fd9-83460609556f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.040543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:56.060935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.060935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.060935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.060935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.061868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:56.169460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.170904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b867-23f6-4cad-a5bc-8bde04899a80 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.189187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 726/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:58.141269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:58.141983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:58.141983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:58.143224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:49:58.148851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10d2c1-a081-4e19-b965-4827d5343d8d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:58.149274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10d2c1-a081-4e19-b965-4827d5343d8d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:58.154711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10d2c1-a081-4e19-b965-4827d5343d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:58.215919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5b10d2c1-a081-4e19-b965-4827d5343d8d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:58.217132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5b10d2c1-a081-4e19-b965-4827d5343d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:58.256519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:58.315691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:49:58.604743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:58.606279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:58.711320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364049-e8e7-4052-9cb4-034870578b3a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:58.748947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:58.788530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:58.789101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:58.789399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:58.789695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:58.791334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:58.904867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:58.906299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473a16f-b71e-490a-b4ba-3c047a8a081a service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:58.925775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 737/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:00.856344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:00.856918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:00.857100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:00.858570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:00.863826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6ba7-ea2f-469b-93c0-7165811888aa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:00.864262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6ba7-ea2f-469b-93c0-7165811888aa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:00.864381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6ba7-ea2f-469b-93c0-7165811888aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:00.931382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-bfec6ba7-ea2f-469b-93c0-7165811888aa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:00.932598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bfec6ba7-ea2f-469b-93c0-7165811888aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:00.950650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:01.027877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:01.313841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:01.315404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:01.417726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1855b04-a673-4104-870c-e84f89d327c5 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:01.483464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:01.490347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:01.491042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:01.491317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:01.491588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:01.493247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:01.602019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:01.603386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d24b-cfc2-4deb-8a8a-be9228a32554 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:01.621228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 729/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:03.576453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:03.577018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:03.577018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:03.578510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:03.583750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58dd8-a1a5-4e70-9e7d-6689a437e22f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:03.584740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58dd8-a1a5-4e70-9e7d-6689a437e22f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:03.587099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58dd8-a1a5-4e70-9e7d-6689a437e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:03.651408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e8e58dd8-a1a5-4e70-9e7d-6689a437e22f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:03.652605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e8e58dd8-a1a5-4e70-9e7d-6689a437e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:03.700990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:03.751086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:04.036530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:04.038682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:04.141637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e00f-9bfa-46d4-8361-ea52f7548490 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:04.188547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:04.214343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:04.214937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:04.215213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:04.215482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:04.217107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:04.327104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:04.328928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155da7a-f5ac-4dd0-9c6f-8f89fca04722 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:04.347918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 740/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:13.749122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=22 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:14.345664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=66 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:24.092041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f6a-58b8-410d-9de8-1d1b4f0aa54d None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:24.092614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f6a-58b8-410d-9de8-1d1b4f0aa54d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:24.092614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f6a-58b8-410d-9de8-1d1b4f0aa54d None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:24.094014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 731/1471] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:24.099202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa7b8-1f44-412c-a594-6d2d327587a8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:24.099618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa7b8-1f44-412c-a594-6d2d327587a8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:24.099720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa7b8-1f44-412c-a594-6d2d327587a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:24.166025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-399aa7b8-1f44-412c-a594-6d2d327587a8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:24.167229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-399aa7b8-1f44-412c-a594-6d2d327587a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:24.262103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 741/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:24.564814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:24.565094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:24.565362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:24.566734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 732/1473] 10.222.0.13 () {54 vars in 967 bytes} [Tue Aug 30 14:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:24.572198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f29-ce1e-443c-91ba-72f832080813 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:24.572486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f29-ce1e-443c-91ba-72f832080813 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:24.572795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6f29-ce1e-443c-91ba-72f832080813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:24.649715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-09fb6f29-ce1e-443c-91ba-72f832080813 None None] MFA Rules not processed for user `f8125d6e3bd74258be79e477260a977b`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:24.650916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-09fb6f29-ce1e-443c-91ba-72f832080813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:24.671031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:24.725738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 742/1474] 10.222.0.13 () {58 vars in 1064 bytes} [Tue Aug 30 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:24.733458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:24.734974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:24.840812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234264-e7ca-4242-9700-b80299e216c3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:24.913106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:24.913875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:24.914151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:24.914417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:24.916003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:24.968732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:25.023586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:25.025088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab8f9-56dd-4fe6-a632-07f3c0095e9e service glance] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:25.043849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 733/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:27.059334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:27.059866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:27.059866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:27.061214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 743/1476] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:27.066473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f7369-c99d-4e84-8cd7-f8578621ac81 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:27.066890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f7369-c99d-4e84-8cd7-f8578621ac81 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:27.067044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f7369-c99d-4e84-8cd7-f8578621ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:27.133581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f97f7369-c99d-4e84-8cd7-f8578621ac81 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:27.134785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f97f7369-c99d-4e84-8cd7-f8578621ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:27.230789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 734/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:27.503170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:27.504728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:27.632383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830507d-6c58-4d08-bf50-3309511c18f5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:27.681055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:27.724528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:27.725194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:27.725471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:27.725741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:27.726376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:27.728112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:50:27.728112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:50:27.728112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:50:27.729289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b266c9-e769-46eb-9c61-50b608201f88 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:27.749439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 744/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Aug 30 14:50:27 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:29.701106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.701652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.701652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.702986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 735/1479] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:29.708302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29349af4-fc5f-4903-b2dd-cd0eadbd0ccc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.708754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29349af4-fc5f-4903-b2dd-cd0eadbd0ccc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.708884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29349af4-fc5f-4903-b2dd-cd0eadbd0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.775501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-29349af4-fc5f-4903-b2dd-cd0eadbd0ccc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.776747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-29349af4-fc5f-4903-b2dd-cd0eadbd0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:29.878489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 745/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:30.177448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:30.177448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.186743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.330338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63452-f733-491a-9d13-457957fb75ef None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:30.409695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.449124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:30.449649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.449925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.450191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.451787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.549410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:30.551003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fbf48-35e4-40b9-88cb-7d9e941a6446 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:30.569957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 736/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:32.694910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:32.695493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:32.695493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:32.696811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 746/1482] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:32.702122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dd84b-82dc-4370-93be-522a63489333 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:32.702517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dd84b-82dc-4370-93be-522a63489333 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:32.702680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dd84b-82dc-4370-93be-522a63489333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:32.769598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ff6dd84b-82dc-4370-93be-522a63489333 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:32.770813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ff6dd84b-82dc-4370-93be-522a63489333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:32.819384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:32.870166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 737/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:33.157235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:33.159043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:33.184792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:33.266137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114876c-15c0-447a-96e0-827bd8621208 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:33.339697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:33.340289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:33.340562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:33.340923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:33.342502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:33.415778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:33.450417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:33.451847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977ec5-e2df-43bb-8c38-a606612891f5 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:33.470134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 747/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:35.461363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.461895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.461895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.463179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 738/1485] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:35.468521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb256e-c183-4f31-ba36-924288e41e1e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.468927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb256e-c183-4f31-ba36-924288e41e1e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.469107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb256e-c183-4f31-ba36-924288e41e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.534404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-eedb256e-c183-4f31-ba36-924288e41e1e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:35.535618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-eedb256e-c183-4f31-ba36-924288e41e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:35.632098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 748/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:35.931026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:35.932553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:36.039865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2948-4f4d-45fc-b8cf-6cbbe80e928b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:36.124807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:36.126429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:36.127027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:36.127305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:36.127576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:36.129216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:36.237143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:36.238586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43616723-aeb1-4f4a-8612-5317adf62fbc service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:36.256634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 739/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:38.359797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:38.360381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:38.360381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:38.361705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 749/1488] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:38.367560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1929-a6a9-4f37-a98f-5bedaefc7246 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:38.367992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1929-a6a9-4f37-a98f-5bedaefc7246 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:38.368127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1929-a6a9-4f37-a98f-5bedaefc7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:38.434366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8ffb1929-a6a9-4f37-a98f-5bedaefc7246 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:38.435567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8ffb1929-a6a9-4f37-a98f-5bedaefc7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:38.486876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:38.531294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 740/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:38.820673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:38.822219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:38.859084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:38.927493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978337e8-c898-4862-b51c-b7f52c551b82 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:38.999141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:38.999739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:39.000011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:39.000278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:39.001885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:39.080018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:39.108947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:39.110372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e12db-b097-4e30-acb7-f97e64167677 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:39.128397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 750/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:41.379141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:41.379743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:41.379743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:41.382023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 741/1491] 10.222.0.13 () {54 vars in 927 bytes} [Tue Aug 30 14:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:41.387107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712ab-3842-47d9-bdf2-2dd19a89dce5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:41.387530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712ab-3842-47d9-bdf2-2dd19a89dce5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:41.387660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712ab-3842-47d9-bdf2-2dd19a89dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:41.452998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-56a712ab-3842-47d9-bdf2-2dd19a89dce5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:41.454197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-56a712ab-3842-47d9-bdf2-2dd19a89dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:41.550990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 751/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Tue Aug 30 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:41.843289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:41.844874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:41.949586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a20ed-d313-4945-8735-69d3ddfc7171 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:42.022641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:42.023243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:42.023524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:42.023798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:42.025445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:42.035710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:42.252649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:42.254113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98353-aa39-4069-a6f2-828d2552789f service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:42.273305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 742/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:51.549252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=82 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:52.270070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=50 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:24.828544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:24.829079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:24.829197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:24.905510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:24.906962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.004242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 752/1494] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:25.012487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:25.013002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:25.013113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:25.088618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:25.089760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.185925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 743/1495] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:25.190655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:25.192490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.203856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99bf7-ebaf-4d13-8645-99a422c5dda2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:25.264688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:25.300233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:25.301794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:25.302069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:25.302329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:25.302995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:52:25.303289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:25.304289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:25.304289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:52:25.304289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:52:25.305225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:25.324258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 753/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:52:25.325142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:25.334923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b108d-6fe3-4077-ba4b-9bbb8059143f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:25.398706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:25.433100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:25.433704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:25.433980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:25.434247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:25.434867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:25.436590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:25.436590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:52:25.436590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:52:25.437803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:25.567617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 744/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:52:25 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:52:25.572017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:25.573566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.607488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0363b-41ad-4039-9c4e-fdaf822be9ca admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:25.701115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:25.701709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:25.701984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:25.702251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:25.702867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:25.703864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:25.703864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:52:25.703864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:52:25.705109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:25.793317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 754/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:52:25 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:52:25.797652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:25.799187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.862149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0e53c-e66e-40ae-a0fb-666089365e34 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:25.945636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:25.955824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:25.958586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:25.958586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:25.958586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:25.958586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:25.959469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:25.959469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:52:25.959469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:52:25.960334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:25.972618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 745/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:52:25.976805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:25.978358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:25.989796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f3e50-e43e-4522-a577-46c823411b8a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:26.015393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.086858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:26.087452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.087813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.088077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.088739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:26.089775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:26.089775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:52:26.089775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:52:26.090653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0c39-e8ae-46b5-b6d1-5e648c60d437 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:26.104239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 755/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:52:26.108457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:26.109990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.143914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608a54-f857-4ecb-b8c8-17d234703993 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:26.237195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:26.237773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.238057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.238329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] PATH_INFO: `/v3/projects/7874790018cc417d91cf166fe8d9ef59/users/dfd8c358157747709f46e970c4f3c11c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.260593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7874790018cc417d91cf166fe8d9ef59, user_id=dfd8c358157747709f46e970c4f3c11c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:26.261656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:26.261656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:52:26.261656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:52:26.263594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65296e0-65ad-497e-8ecd-9703261861ad admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:26.336775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 746/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:52:26 2022] PUT /identity/v3/projects/7874790018cc417d91cf166fe8d9ef59/users/dfd8c358157747709f46e970c4f3c11c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:26.349173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14971-0d3c-45eb-ac19-d2cc6e603491 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.349460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14971-0d3c-45eb-ac19-d2cc6e603491 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.349738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14971-0d3c-45eb-ac19-d2cc6e603491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.408143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3bd14971-0d3c-45eb-ac19-d2cc6e603491 None None] MFA Rules not processed for user `dfd8c358157747709f46e970c4f3c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:26.409376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3bd14971-0d3c-45eb-ac19-d2cc6e603491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.484485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 756/1502] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:26.497991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558102-0264-4b79-9d59-76a569069207 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.498283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558102-0264-4b79-9d59-76a569069207 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.498561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558102-0264-4b79-9d59-76a569069207 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.499932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 747/1503] 10.222.0.13 () {54 vars in 964 bytes} [Tue Aug 30 14:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:52:26.505507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d1da-c922-49f9-9087-735b5c9c2f8c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.506079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d1da-c922-49f9-9087-735b5c9c2f8c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.506362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d1da-c922-49f9-9087-735b5c9c2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.537901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.582473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-87a3d1da-c922-49f9-9087-735b5c9c2f8c None None] MFA Rules not processed for user `136f5fbf04ab4000b0c80f1955f6515b`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:26.584571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-87a3d1da-c922-49f9-9087-735b5c9c2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.660198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 757/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Aug 30 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:52:26.670580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558102-0264-4b79-9d59-76a569069207 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:26.672092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-79558102-0264-4b79-9d59-76a569069207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.722306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.776585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558102-0264-4b79-9d59-76a569069207 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:26.850816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:26.851415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:26.851689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:26.851955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:26.853579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:26.951443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:26.952912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:26.956332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.971084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 748/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:27.023551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600dce5-d292-410b-a5f7-aa5625edee83 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.023991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600dce5-d292-410b-a5f7-aa5625edee83 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.024102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600dce5-d292-410b-a5f7-aa5625edee83 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.025362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 758/1506] 10.222.0.13 () {52 vars in 830 bytes} [Tue Aug 30 14:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:52:27.028951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.030108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.129493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a7a67-bb24-435c-a1f5-47fa4cdacdb0 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.221326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.221939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.222214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.222487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] PATH_INFO: `/v3/users/dfd8c358157747709f46e970c4f3c11c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.235344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd8c358157747709f46e970c4f3c11c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.236377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:27.236377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:52:27.236377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:52:27.237644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.247212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.395082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd8c358157747709f46e970c4f3c11c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:27.396164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd8c358157747709f46e970c4f3c11c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:27.410140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd8c358157747709f46e970c4f3c11c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:27.471390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd8c358157747709f46e970c4f3c11c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:27.471823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd8c358157747709f46e970c4f3c11c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:27.499816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 749/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:52:27 2022] DELETE /identity/v3/users/dfd8c358157747709f46e970c4f3c11c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:27.504190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.504474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.505361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.562401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:27.563600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.639814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.653118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 759/1508] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:27.662915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:27.664154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.766012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ccd96-b38d-4423-ab35-37f45f05dab9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:27.821392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:27.840426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:27.841064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:27.841343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:27.841612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:27.843228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:27.951915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:27.953346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40c80-0894-41b4-8dff-9e38a28111ae service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:27.972066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 750/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:28.451542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:28.453021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:28.465147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98673-b821-4a48-9611-4ab8b6c1ae91 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:28.566685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:28.567357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:28.567679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:28.567972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] PATH_INFO: `/v3/projects/7874790018cc417d91cf166fe8d9ef59` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:28.579315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7874790018cc417d91cf166fe8d9ef59)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:28.580364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:52:28.580364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:52:28.580364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:52:28.581608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:28.698782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7874790018cc417d91cf166fe8d9ef59', 'request_id': 'req-60b635ee-3f3b-4dd9-829a-cb14641822f5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:28.712816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7874790018cc417d91cf166fe8d9ef59', 'request_id': 'req-60b635ee-3f3b-4dd9-829a-cb14641822f5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:28.719057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7874790018cc417d91cf166fe8d9ef59', 'request_id': 'req-60b635ee-3f3b-4dd9-829a-cb14641822f5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:28.787753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] The token cache is being invalidate because project 7874790018cc417d91cf166fe8d9ef59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:52:28.787967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:28.788493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-60b635ee-3f3b-4dd9-829a-cb14641822f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:28.789840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 760/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:52:28 2022] DELETE /identity/v3/projects/7874790018cc417d91cf166fe8d9ef59 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:37.969833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=62 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:38.784917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:06.187710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:06.188535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:06.188727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:06.190427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:06.196406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26b05-43f9-478c-b5a4-a34738c2f23d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:06.196938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26b05-43f9-478c-b5a4-a34738c2f23d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:06.197075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26b05-43f9-478c-b5a4-a34738c2f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:06.277327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-55b26b05-43f9-478c-b5a4-a34738c2f23d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:06.278535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-55b26b05-43f9-478c-b5a4-a34738c2f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:06.383199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:06.542622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:06.544788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:06.663611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f5755-cfad-4698-a9fd-bc4891cf1525 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:06.669180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:06.674379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:06.674379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:06.674379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:06.679326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:06.680933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ec09-4fef-4aa1-bd15-b85d27416220 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:06.690205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 752/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:07.526204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef00a-cdf0-41d5-8c80-de84d858dc6a None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:07.526842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef00a-cdf0-41d5-8c80-de84d858dc6a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:07.526842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef00a-cdf0-41d5-8c80-de84d858dc6a None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:07.528086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:07.533533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d5a9-e17c-42e2-9039-adb7d89294ea None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:07.533993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d5a9-e17c-42e2-9039-adb7d89294ea None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:07.534472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d5a9-e17c-42e2-9039-adb7d89294ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:07.556979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ed94d5a9-e17c-42e2-9039-adb7d89294ea None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:07.558174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ed94d5a9-e17c-42e2-9039-adb7d89294ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:07.565864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:07.721792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebef00a-cdf0-41d5-8c80-de84d858dc6a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:07.736746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebef00a-cdf0-41d5-8c80-de84d858dc6a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:07.742915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:07.743509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:07.743783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:07.744052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:07.752280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:07.753928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4333c-bfb4-41b3-a19d-8808ccb33650 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:07.764247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 763/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:08.496633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543fbd-ece2-4070-bc6e-1f0764b31209 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:08.496947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543fbd-ece2-4070-bc6e-1f0764b31209 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:08.497220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543fbd-ece2-4070-bc6e-1f0764b31209 None None] PATH_INFO: `/v3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:08.498503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 754/1517] 10.222.0.17 () {54 vars in 925 bytes} [Tue Aug 30 14:54:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:54:08.511436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327db31-4f36-45dc-998c-0e1ca66585ae None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:08.511767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327db31-4f36-45dc-998c-0e1ca66585ae None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:08.512040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327db31-4f36-45dc-998c-0e1ca66585ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:08.571520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7327db31-4f36-45dc-998c-0e1ca66585ae None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:08.572840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7327db31-4f36-45dc-998c-0e1ca66585ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:08.590060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:08.646473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 764/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 30 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:12.609954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e629-fbe9-48f5-94eb-ce322c9d1434 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:12.610503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e629-fbe9-48f5-94eb-ce322c9d1434 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:12.610503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e629-fbe9-48f5-94eb-ce322c9d1434 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:12.611774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 755/1519] 10.222.0.13 () {54 vars in 961 bytes} [Tue Aug 30 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:12.616610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37a0f-3174-4e5a-bb97-424334e7ca4c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:12.617061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37a0f-3174-4e5a-bb97-424334e7ca4c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:12.617168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37a0f-3174-4e5a-bb97-424334e7ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:12.637328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ccc37a0f-3174-4e5a-bb97-424334e7ca4c None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:12.638505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ccc37a0f-3174-4e5a-bb97-424334e7ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:12.647796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 765/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Aug 30 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:12.655423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e629-fbe9-48f5-94eb-ce322c9d1434 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:12.669436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e629-fbe9-48f5-94eb-ce322c9d1434 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:12.674455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:12.675037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:12.675314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:12.675578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:12.684633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:12.686224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059922e1-162e-427f-84bb-6da01d6a0645 service placement] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:12.696561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 756/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:54:18.981831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246c19-d2df-4c39-a873-aeca71ee47be None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:18.982389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246c19-d2df-4c39-a873-aeca71ee47be None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:18.982389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246c19-d2df-4c39-a873-aeca71ee47be None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:18.983632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:18.988455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824b9d-c555-4635-939b-92b846e7b4e3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:18.988899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824b9d-c555-4635-939b-92b846e7b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:18.989025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824b9d-c555-4635-939b-92b846e7b4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:19.008815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6f824b9d-c555-4635-939b-92b846e7b4e3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:19.010000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6f824b9d-c555-4635-939b-92b846e7b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:19.017741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:19.186183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246c19-d2df-4c39-a873-aeca71ee47be None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:19.201540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246c19-d2df-4c39-a873-aeca71ee47be None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:19.206944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:19.207687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:19.207966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:19.208256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:19.217299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:19.218913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969a939-24a8-4c81-a003-145fd1313c67 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:19.228494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 767/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:20.050595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5fd9-0cd2-4913-85ff-fbafe98af837 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.051125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5fd9-0cd2-4913-85ff-fbafe98af837 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.051125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5fd9-0cd2-4913-85ff-fbafe98af837 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.052498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:20.058144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039241-38dc-45de-8d6c-a27959d72dcc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.058537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039241-38dc-45de-8d6c-a27959d72dcc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.058683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039241-38dc-45de-8d6c-a27959d72dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.078046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b3039241-38dc-45de-8d6c-a27959d72dcc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:20.079244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b3039241-38dc-45de-8d6c-a27959d72dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:20.087341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:20.239179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5fd9-0cd2-4913-85ff-fbafe98af837 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:20.254177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5fd9-0cd2-4913-85ff-fbafe98af837 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:20.259879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:20.260465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:20.260857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:20.261127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:20.269115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:20.271859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e841f6c-2be8-4bc4-b493-3c1bbfb9235e service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:20.281156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 759/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:24.130576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:24.131255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:24.131255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:24.132433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:24.137714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe4ad5-a45b-4339-bdbc-d7e242c07ae3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:24.138100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe4ad5-a45b-4339-bdbc-d7e242c07ae3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:24.138301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe4ad5-a45b-4339-bdbc-d7e242c07ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:24.158335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cafe4ad5-a45b-4339-bdbc-d7e242c07ae3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:24.159530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cafe4ad5-a45b-4339-bdbc-d7e242c07ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:24.167928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:24.454270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:24.456029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:24.534597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be445bf2-4bf6-4044-af67-ea6719faa9e4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:24.538220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:24.538899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:24.539087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:24.539353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:24.548119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:24.549584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca50338-df00-4b74-adcf-8f69bfe0b8d0 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:24.559023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 770/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:26.462551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09ced-f823-4fb0-82a0-b750cfae20d8 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:26.463121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09ced-f823-4fb0-82a0-b750cfae20d8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:26.463121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09ced-f823-4fb0-82a0-b750cfae20d8 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:26.464457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:26.469877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b22f7-1633-4e53-a06b-4222e58a0cb6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:26.470310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b22f7-1633-4e53-a06b-4222e58a0cb6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:26.470407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b22f7-1633-4e53-a06b-4222e58a0cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:26.490221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ee3b22f7-1633-4e53-a06b-4222e58a0cb6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:26.491963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ee3b22f7-1633-4e53-a06b-4222e58a0cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:26.500148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:26.784064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba09ced-f823-4fb0-82a0-b750cfae20d8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:26.795583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba09ced-f823-4fb0-82a0-b750cfae20d8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:26.799282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:26.799875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:26.800155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:26.800454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:26.810782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:26.812226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a4a76-a415-494f-b25b-d3ffceb25522 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:26.821872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 762/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:30.291701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:30.292252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:30.292252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:30.293617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:30.298954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b99b4-7c49-4180-9a21-fca663c7f568 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:30.301442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b99b4-7c49-4180-9a21-fca663c7f568 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:30.301442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b99b4-7c49-4180-9a21-fca663c7f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:30.308039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=81 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:30.321268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c61b99b4-7c49-4180-9a21-fca663c7f568 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:30.324289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c61b99b4-7c49-4180-9a21-fca663c7f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:30.330629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:30.887927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:30.889641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:30.954923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:30.975046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ed89-bc97-4782-956f-fcc3dac9cb3c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:30.975046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:30.975046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:30.975046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:30.975695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:30.982202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:30.983618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68818987-11c0-4455-8ce6-3da22ec54314 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:30.993489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 773/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:32.938372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:32.939002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:32.939002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:32.940250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:54:32.945499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e116-46ca-4588-837b-cc010f02fb4b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:32.945957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e116-46ca-4588-837b-cc010f02fb4b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:32.946064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e116-46ca-4588-837b-cc010f02fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:32.965810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9b53e116-46ca-4588-837b-cc010f02fb4b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:32.966978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9b53e116-46ca-4588-837b-cc010f02fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:32.975317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:33.530541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:33.532244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:33.546579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d30f9-844e-49f1-afe0-308ee14b11dd None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:33.550080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:33.554722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:33.554722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:33.554722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:33.560202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:33.561703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6807cc-283d-4549-bf2b-1290b5afa97a service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:33.571728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 765/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:42.961043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=11 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:43.566919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=8 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:01.090219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.090828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.090828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.121921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.123158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.132646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 775/1540] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.142667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.143841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.144445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.179283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.181212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.194523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 766/1541] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.199735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.214070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37f37a-77dd-4d83-90c1-5b093340a0a8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.225526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.226150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.226428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.226697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.227355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:01.227658 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.229441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53514ab6-53e9-4575-a20c-b69dcf364589 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.249214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 776/1542] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:01.258937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.270543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ff5f1-f829-4c2c-aec2-46e5e3fa6b48 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.281245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.282444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.282958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.283462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.284929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.287623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.328794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff689d-4fef-4257-8628-8b5b06b8a98d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.329172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff689d-4fef-4257-8628-8b5b06b8a98d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.329363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff689d-4fef-4257-8628-8b5b06b8a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.366458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-25ff689d-4fef-4257-8628-8b5b06b8a98d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.368318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-25ff689d-4fef-4257-8628-8b5b06b8a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.383874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 777/1543] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:01.385425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892e5f-cf4e-4361-9cf9-00e2500e1aa6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.394719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892e5f-cf4e-4361-9cf9-00e2500e1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.394719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892e5f-cf4e-4361-9cf9-00e2500e1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.413113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a1892e5f-cf4e-4361-9cf9-00e2500e1aa6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.414400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a1892e5f-cf4e-4361-9cf9-00e2500e1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.432108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 778/1544] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.433664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fe82-e809-4285-9620-d6dfea44c705 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.433953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fe82-e809-4285-9620-d6dfea44c705 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.434225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8fe82-e809-4285-9620-d6dfea44c705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.434967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 767/1545] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:01.439545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.462222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a3b8fe82-e809-4285-9620-d6dfea44c705 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.464765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a3b8fe82-e809-4285-9620-d6dfea44c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.563892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61826785-d757-4da3-98bb-4efaf5f77280 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.576123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.577314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.577831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.578332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.579892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.581679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:01.581679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:56:01.581679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:56:01.583465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfc006-4d5a-4ccc-bb9b-f987f9eae8e9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.604141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 779/1546] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.605575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560ea4-a22b-4951-a67c-7af52668f9ab None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.612263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560ea4-a22b-4951-a67c-7af52668f9ab None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.612263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560ea4-a22b-4951-a67c-7af52668f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.626302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-40560ea4-a22b-4951-a67c-7af52668f9ab None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.627427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-40560ea4-a22b-4951-a67c-7af52668f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.635944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 780/1547] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.637168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dd57-c7ba-4f3e-ab56-45f220c89eb3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.637443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dd57-c7ba-4f3e-ab56-45f220c89eb3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.637714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98dd57-c7ba-4f3e-ab56-45f220c89eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.658984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cb98dd57-c7ba-4f3e-ab56-45f220c89eb3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.662469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cb98dd57-c7ba-4f3e-ab56-45f220c89eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.665404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 768/1548] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:01.666997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffece4-ff81-4271-a7af-39f8c16dbc76 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.667290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffece4-ff81-4271-a7af-39f8c16dbc76 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.667551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffece4-ff81-4271-a7af-39f8c16dbc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.669349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 781/1549] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.670570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.670977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.671453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.689870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e9ffece4-ff81-4271-a7af-39f8c16dbc76 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.691119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e9ffece4-ff81-4271-a7af-39f8c16dbc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.692129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.693289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.699329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 769/1550] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.700796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddbec9-3862-4e93-b863-0e7ee3b7fb7e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.701140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 782/1551] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.701968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.707943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddbec9-3862-4e93-b863-0e7ee3b7fb7e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.708331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddbec9-3862-4e93-b863-0e7ee3b7fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.713295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b462b0-d6cc-475d-bae9-18b65267b36d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.717877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.718463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.718734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.718998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.719638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:01.719935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.721543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.728142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d5ddbec9-3862-4e93-b863-0e7ee3b7fb7e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.729369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d5ddbec9-3862-4e93-b863-0e7ee3b7fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.733204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 783/1552] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:01.734068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.744911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 770/1553] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.744911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.744911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.744911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.752582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9632f-3a0f-471c-9e54-dbbdd100103b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.758698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.759401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.759586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.759841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.760273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.760482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:01.760874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.761700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.762582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28c0e-d86c-4810-b97d-93c285b8c929 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.769716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 771/1554] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.771362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.788803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 784/1555] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:01.788803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b778-cc33-48ef-b0c9-876ec46d7107 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.788803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b778-cc33-48ef-b0c9-876ec46d7107 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.788803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b778-cc33-48ef-b0c9-876ec46d7107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.789261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a638d-d447-465e-8dc1-56812bacbe15 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.789261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.789450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.789714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.789988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.791207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.792403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d502e0b-6b2e-40cf-86cb-e9d34dbe2bf9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.803523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a587b778-cc33-48ef-b0c9-876ec46d7107 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.804830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a587b778-cc33-48ef-b0c9-876ec46d7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.808151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 772/1556] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:01.809570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.810516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.810516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.816826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 785/1557] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.818038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396224a-0a43-43b8-9026-93ae2204e19f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.818322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396224a-0a43-43b8-9026-93ae2204e19f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.818595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396224a-0a43-43b8-9026-93ae2204e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.832726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.833938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.838945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c396224a-0a43-43b8-9026-93ae2204e19f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.840136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c396224a-0a43-43b8-9026-93ae2204e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.842078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 773/1558] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.842827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.851037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 786/1559] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.851037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.855079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.855079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.857579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bab52-ea2b-407d-849b-e93c4741b640 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.862261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.863396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.863678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.863947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.864582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.866539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02672bb6-5e49-4c83-bf8e-9149beb6b3ae admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.872430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.873655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:01.884290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 787/1560] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:01.885077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:01.894611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab00d4-3462-42fb-830d-c13b36b02109 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:01.899217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:01.899800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.900076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.900346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.901006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:01.902061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:01.902061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:56:01.902061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:56:01.903503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:01.974154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 774/1561] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:01.975413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:01.975699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:01.975974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:01.995778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:01.997235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.002738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 788/1562] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.004388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.049549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:02.051198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:02.063486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 775/1563] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.064536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.072482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7462f-c6ef-41b1-9054-725e8bf650a3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.074530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9c88b-63fb-431d-93b6-8890811e2ffa None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.077096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.077694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.079097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.079097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.079097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.079354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.079814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.080130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.080446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.080599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.081714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.082024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.083038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:02.083038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:56:02.083038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:56:02.083934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.091310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 789/1564] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:02.092602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.102497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 776/1565] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.102497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.107460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1d16-477a-46be-927f-1f614abb2a86 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.111776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0552e0-1713-42f3-929d-6d5048269307 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.112219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.113126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.113416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.113688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.114380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.114678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.116257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.116963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.117557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.117833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.118101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.118738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.119040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.120615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.128642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 790/1566] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.129782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.146161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 777/1567] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.146694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f49e-c270-4595-ab8c-e1c70daf3c96 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.146812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.149992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daeb3-42ef-4270-a76a-7e3b9ec52ec5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.151179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.152024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.152566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.152861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.153526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.153849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.154867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.155449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.155583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.155723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.155994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.156647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.158575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.169184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 791/1568] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.170035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.180395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16899-34b6-48a3-a0e8-afcfe39fd428 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.184982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.185551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.188248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.188248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.188248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.188708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.262174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 778/1569] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.262174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.270433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9323-6cfb-416d-a2c4-f38c0b820b54 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.275214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.275804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.276081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.276350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.277398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:02.277700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.279299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.290610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 792/1570] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.290610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.299962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 779/1571] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:02.299962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.300274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffc6d3-8553-4cba-b004-00ace761ed9a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.304460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c5c5-3e8a-4147-b57f-16c084aeba39 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.305523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.306235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.306443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.306727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] PATH_INFO: `/v3/projects/93bcc00307f247c1ae99c0640b1f19d7/users/bd2a46a3fc3c44779e324d28070fb17e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.309068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.309654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.309927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.310192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.310816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.312708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.323746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bcc00307f247c1ae99c0640b1f19d7, user_id=bd2a46a3fc3c44779e324d28070fb17e, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.324817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:02.324817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:56:02.324817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:56:02.326766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.385933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 780/1572] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.386878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.408591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 793/1573] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:02 2022] PUT /identity/v3/projects/93bcc00307f247c1ae99c0640b1f19d7/users/bd2a46a3fc3c44779e324d28070fb17e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:02.409865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.450646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cca5a-4497-488b-9963-effab65b356a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.475561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dce49-fade-452c-ba30-5102f91f358b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.480184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.480802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.481074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.481341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.481955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.483836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.507823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.508422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.508720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.508990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.509619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.511505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.590880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 794/1574] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.591677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.645103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 781/1575] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.645323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:02.645504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.653201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c015c1-a9c1-4a96-8e55-309953c88ec5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.655501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:02.710886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.711404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.711684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.711952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.712063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494d35-9efb-417c-a068-307928f3aeb2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.712589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.714515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.723373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.724504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.724947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.725330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.726240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.728088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.738511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 782/1576] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:02.739491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.749046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52b240-83f2-46bb-86b2-afce39c91d29 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.753794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.754378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.754658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.754930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.755559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.757251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.767412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 783/1577] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:02.768159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.778132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b6590-5fae-48cc-b0a0-64ec9d8f0530 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.782728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.783279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.783562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.783826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.785081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.786900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fe91-aae2-4bd4-934e-3617c12475be admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.806706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 795/1578] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.807546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.868503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14490e-8499-48fd-9569-c0f23b47c537 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.873335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:02.873936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.877506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.877506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.877506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:02.877506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:02.899823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 784/1579] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.901579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:02.901579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:02.901867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:02.920815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:02.922021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:02.967088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 796/1580] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:02.967815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.977501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12fdb-0518-49dc-8a5a-68198ee1bdc2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:02.985259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 785/1581] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:02.986626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:02.996631 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b31b-2cb2-45a6-befe-0699b7906c6f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.003951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.004769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.005050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.005320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.005982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.007949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.035561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.036163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.036443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.036744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.037368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.039274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.115751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 786/1582] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.116633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.126301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d846b0-845b-46cf-b9a6-dfafae5bcacb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.131580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.132144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.132420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.132717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.133340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.134919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.149194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 797/1583] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:02 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.149700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 787/1584] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.150083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.150192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.152417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.156567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5739d-feb3-4885-814a-2519a32450c2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.160974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6913b3-71f5-4762-8692-77497f903976 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.161762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.162394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.162660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.162937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.163581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.165222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.165753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.166478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.166592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.166862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.167482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.170624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.176653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 798/1585] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.177548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.187543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b359-a6f1-4494-a002-f00217f0cb9c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.192803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.193414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.193692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.193973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.194579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.196473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.264284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 788/1586] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.265141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.275589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de0cb2-03be-4839-b19e-7e126801eb37 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.280553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.281159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.281485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.281698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.282339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.283910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.290178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 799/1587] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:03.290178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.296687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 789/1588] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.296687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.307385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a07c-a8de-44fb-84fc-deb836b7df77 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.312001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.312584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.312886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.313156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.313784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.315483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.326828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 790/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.330852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.336806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.341957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870cf3d-4978-4bae-8c4f-18000b5a3d5c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.346581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.347829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.348164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.348583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.352092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800bcf-0b4c-4ea1-bd5c-a79214045d82 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.352262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.352262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.352966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.353564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.353844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.354114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.366123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 791/1590] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.366123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.366380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.366380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.374369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa778d-2e5a-4266-b2c1-6fc5deabb703 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.375496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 800/1591] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:03.376140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.379415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.380850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.380850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.380850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] PATH_INFO: `/v3/projects/1fa0a5e3ed03424593b0f8f263e726de/users/cd84bac34f7e40449b1ed0caa7fa4fec/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.385333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b391-5734-4d36-830c-8f7892c8b7f5 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.390076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.390736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.390999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.391276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] PATH_INFO: `/v3/projects/f714e538a7cf4854adb26d5ca304f5b5/users/aa0732d3aa3b432c809f2245aff27805/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.397231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa0a5e3ed03424593b0f8f263e726de, user_id=cd84bac34f7e40449b1ed0caa7fa4fec, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.400179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.408132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f714e538a7cf4854adb26d5ca304f5b5, user_id=aa0732d3aa3b432c809f2245aff27805, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.411481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.550068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 801/1592] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/f714e538a7cf4854adb26d5ca304f5b5/users/aa0732d3aa3b432c809f2245aff27805/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:03.550802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 792/1593] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/1fa0a5e3ed03424593b0f8f263e726de/users/cd84bac34f7e40449b1ed0caa7fa4fec/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:03.551132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.552010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.626146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0602f-3fe6-424c-abd3-648cee83e4f6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.631415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861383-8f1e-4856-89b7-dc5f22f297d9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.631673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.632305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.632583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.632883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.633534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.635132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.639367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.640190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.641028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.641304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.641966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.643642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.653289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 802/1594] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.654783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.660949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 793/1595] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.660949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.669585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1e205-30c0-4408-a43c-3980cd09314f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.670940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bdbee-c3d0-45d2-bee4-06c1fb2bbdda admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.676335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.676491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.677048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.677177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.677347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.677535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.677655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.677913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.678262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.678709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.679971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.680418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439686e-598a-49a3-bb2b-663d9dd976d2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.699973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 803/1596] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.699973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.700190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 794/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.700190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736e6c-750d-464f-a13d-7d4132bbb85b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.700190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736e6c-750d-464f-a13d-7d4132bbb85b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.700190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97736e6c-750d-464f-a13d-7d4132bbb85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.717296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf5973-16b7-41c2-addf-e1fa72e67561 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.722829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-97736e6c-750d-464f-a13d-7d4132bbb85b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.723053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.723619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.723902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.724177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.724632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-97736e6c-750d-464f-a13d-7d4132bbb85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.725062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.727156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.733572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 795/1598] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.735209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.735590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.735958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.742031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 804/1599] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.746369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.757774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfb17-3cc0-418b-8da5-23ee969df995 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.762510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.763112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.763387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.763656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.764290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.766227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.771847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] MFA Rules not processed for user `aa0732d3aa3b432c809f2245aff27805`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:03.773718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.779573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 805/1600] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.779573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.801355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2dcf8-552a-4ce0-8082-d85b338509b0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.812864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.813510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.814791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.815099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.816292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.819739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.830455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 806/1601] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:03.831415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.841200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860c7e-fb35-4782-a397-d051da32748b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.845816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.846451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.847309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.847565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] PATH_INFO: `/v3/projects/4e87f0ff186d4b739208bf2b8aa2cf20/users/488eb88e27ed47e7856e999ef96efb69/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.849889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:03.856693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 796/1602] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:03.857588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.867652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e87f0ff186d4b739208bf2b8aa2cf20, user_id=488eb88e27ed47e7856e999ef96efb69, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.869222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdc4cb-d5c9-4d81-bbff-99e6e33ff41c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:03.870365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.874054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:03.874720 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:03.874999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:03.875268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] PATH_INFO: `/v3/projects/1250f87a21d14229a7076f0bf5b57b1d/users/af18a3bbb47c47019225b7cf7d30d1c9/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:03.892096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1250f87a21d14229a7076f0bf5b57b1d, user_id=af18a3bbb47c47019225b7cf7d30d1c9, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:03.895064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:03.962310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 807/1603] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/4e87f0ff186d4b739208bf2b8aa2cf20/users/488eb88e27ed47e7856e999ef96efb69/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:03.966804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:03.968389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:03.995281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 797/1604] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/1250f87a21d14229a7076f0bf5b57b1d/users/af18a3bbb47c47019225b7cf7d30d1c9/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:03.995281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.009607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.031132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a452-a1fb-4048-bcd9-5f617d620289 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.075439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d8a8-f536-47c1-8a0d-0986d4f4e21f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.081934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.082721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.082951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.083267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] PATH_INFO: `/v3/projects/c0d0b535e1574e5fbb7e13aa21c3614c/users/a5bf32548bcb4aea809e2561ba2b2f82/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.095449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.095881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.096157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.096422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.099154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d0b535e1574e5fbb7e13aa21c3614c, user_id=a5bf32548bcb4aea809e2561ba2b2f82, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.101841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.106589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.108192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.117806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 808/1605] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.118719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.127709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e5a-8fa6-4ead-8350-e9fec602164e service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.132595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.133199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.133469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.133734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] PATH_INFO: `/v3/projects/82e84fb59afb4021a670ec2bf7b8fef4/users/98ce0400557c4afaa309cd4bd34d7430/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.148891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e84fb59afb4021a670ec2bf7b8fef4, user_id=98ce0400557c4afaa309cd4bd34d7430, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.151510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bc608-e66c-4ace-a0d4-9136e8a681f8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.200980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 798/1606] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:03 2022] PUT /identity/v3/projects/c0d0b535e1574e5fbb7e13aa21c3614c/users/a5bf32548bcb4aea809e2561ba2b2f82/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:04.201962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.247988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 809/1607] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:04 2022] PUT /identity/v3/projects/82e84fb59afb4021a670ec2bf7b8fef4/users/98ce0400557c4afaa309cd4bd34d7430/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:04.249299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf135-4842-45a3-8dad-e7e44f011a23 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.249714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf135-4842-45a3-8dad-e7e44f011a23 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.250648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf135-4842-45a3-8dad-e7e44f011a23 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.258256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 810/1608] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 14:56:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:04.259863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cd30-add6-4e04-bbce-6c835d6cf508 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.260221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cd30-add6-4e04-bbce-6c835d6cf508 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.260553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cd30-add6-4e04-bbce-6c835d6cf508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.286334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a854d-2dbc-4bd8-964a-fbe824216a1c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.288337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c601cd30-add6-4e04-bbce-6c835d6cf508 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.290692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c601cd30-add6-4e04-bbce-6c835d6cf508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.361754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.364821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.364821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.364821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] PATH_INFO: `/v3/projects/84414a79400545ce8537afb86eaa740d/users/9cfc4fc898724458af2dea8ab046a98c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.378879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84414a79400545ce8537afb86eaa740d, user_id=9cfc4fc898724458af2dea8ab046a98c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.381598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578e2f0-c55f-4a8a-bf00-5aacae8a0ee5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.384721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 811/1609] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.385215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600d99-d858-4469-9c48-120d4bdeb8c3 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.385394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600d99-d858-4469-9c48-120d4bdeb8c3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.385805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600d99-d858-4469-9c48-120d4bdeb8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.414607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-35600d99-d858-4469-9c48-120d4bdeb8c3 None None] MFA Rules not processed for user `af18a3bbb47c47019225b7cf7d30d1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.415798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-35600d99-d858-4469-9c48-120d4bdeb8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.420898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.491923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 799/1610] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:04 2022] PUT /identity/v3/projects/84414a79400545ce8537afb86eaa740d/users/9cfc4fc898724458af2dea8ab046a98c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:04.491923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec956-4fb3-4827-9333-a8842c922524 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.492223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 812/1611] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.492318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec956-4fb3-4827-9333-a8842c922524 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.492318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec956-4fb3-4827-9333-a8842c922524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.492508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.492508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.492508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.545970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9d3ec956-4fb3-4827-9333-a8842c922524 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.545970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9d3ec956-4fb3-4827-9333-a8842c922524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.551952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.553383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.572782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:04.631427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 800/1612] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.634600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 813/1613] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.635653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.637591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb173b6-77a1-4af2-8ce5-c5a9e10a5f58 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.638144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb173b6-77a1-4af2-8ce5-c5a9e10a5f58 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.638144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb173b6-77a1-4af2-8ce5-c5a9e10a5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.667424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cdb173b6-77a1-4af2-8ce5-c5a9e10a5f58 None None] MFA Rules not processed for user `98ce0400557c4afaa309cd4bd34d7430`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.668742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cdb173b6-77a1-4af2-8ce5-c5a9e10a5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.698286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2729359-7670-42ab-8991-544dfb14ce53 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.702216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.702889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.703244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.703585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.714072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.715548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335959d4-772c-4fa4-8b1e-bd975c59fd33 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.725459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 814/1614] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.730623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.731056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.731641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 801/1615] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fddfc7-23c3-450b-b8d4-0705c3b12726 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fddfc7-23c3-450b-b8d4-0705c3b12726 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fddfc7-23c3-450b-b8d4-0705c3b12726 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 802/1616] 10.222.0.13 () {54 vars in 962 bytes} [Tue Aug 30 14:56:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:04.736903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fddfc7-23c3-450b-b8d4-0705c3b12726 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.753822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fddfc7-23c3-450b-b8d4-0705c3b12726 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.760805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.765205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.765205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.765205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.771626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] MFA Rules not processed for user `9cfc4fc898724458af2dea8ab046a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.772934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.832416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.834136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.845753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 803/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.846585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.869235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 815/1618] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.869235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:04.886071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885536a-e535-4c2e-84e4-3e14e118259e service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.886837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.887455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.887737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.888023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.888133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf6d7-14fa-4512-a884-c82167c4baf8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:04.908389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:04.908600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.909648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.910129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b8726-e0f4-4f99-a2d2-312fc06f5ec8 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.910245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.910471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.911168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:04.914789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:04.935422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 804/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:04.936733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:04.937027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:04.937304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:04.977596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:04.979011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:04.994163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 805/1620] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:04.995073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.062904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.080258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 816/1621] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:04 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:05.087448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.099606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13def749-2673-458b-bdb8-84421393c0f6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.182259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.182889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.183172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.183595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.236019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c96ba-631f-43ed-8fa1-cc4a8f842cbb admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.245916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256140-8dac-4525-95b4-93581572017c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.246903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256140-8dac-4525-95b4-93581572017c service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.247909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256140-8dac-4525-95b4-93581572017c service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.248502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256140-8dac-4525-95b4-93581572017c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.286820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.289107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.307085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 806/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:05.309700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.370940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256140-8dac-4525-95b4-93581572017c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.372682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256140-8dac-4525-95b4-93581572017c service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.393497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 817/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:05.406117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5953-8907-4210-9972-492af41f2e9f None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.406491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5953-8907-4210-9972-492af41f2e9f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.406773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5953-8907-4210-9972-492af41f2e9f None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.408530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 818/1624] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 14:56:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:05.414311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0ccd-b7c4-43f1-9178-fc527c3d5930 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.415343 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.415693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.416034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.421218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.422046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.422389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.428306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.428306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.429417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.458629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.459964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.476341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 819/1625] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:05.476730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.498414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.509086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085be56-d206-4cee-b24f-c739e3806f86 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.515467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.515467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.515467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.515467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.528690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.530333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.542772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 807/1626] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:05.544191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.545067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 820/1627] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:05.563888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8c8d-080e-41b7-865f-be513fa14c27 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.570341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.571298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.571760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.572192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.573038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.575037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.591166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 808/1628] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:05.592547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.604508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d166b-4933-4cdb-86fd-489cb0c86bb4 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.609936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.610883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.611340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.611804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] PATH_INFO: `/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e/users/9c44248855e94499adf7a356c0a5ebfb/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.626866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.632250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36cde3ad2264b73ae8e34627c9e0b1e, user_id=9c44248855e94499adf7a356c0a5ebfb, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.635636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3425a8d-47a3-43bd-a33e-f704c2647deb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.741142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 821/1629] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e/users/9c44248855e94499adf7a356c0a5ebfb/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:05.745247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.765590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d37d1-64a1-4485-96bd-32b63136eaa5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.849831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.891413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19216-ebc1-4c3e-ae8a-faf172879b21 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19216-ebc1-4c3e-ae8a-faf172879b21 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19216-ebc1-4c3e-ae8a-faf172879b21 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 822/1630] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 14:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.903525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.922417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.923805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.926182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.926898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.927782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.930452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:05.935019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:05.936699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:05.948421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 809/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:05.953212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:05.967445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e1c78-3b0e-4f84-9a9b-669e33499fb1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:05.974989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:05.975973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:05.976593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:05.977234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] PATH_INFO: `/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e/users/9c44248855e94499adf7a356c0a5ebfb/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:05.980467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36cde3ad2264b73ae8e34627c9e0b1e, user_id=9c44248855e94499adf7a356c0a5ebfb, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:05.985641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300c6c-a4cc-4620-9a2d-6d8a47467400 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:06.011854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 810/1632] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:05 2022] PUT /identity/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e/users/9c44248855e94499adf7a356c0a5ebfb/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:06.051351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:06.051823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:06.056010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:06.114034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 823/1633] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:06.150693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] MFA Rules not processed for user `9c44248855e94499adf7a356c0a5ebfb`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:06.152400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:06.262482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 811/1634] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:06.624334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:06.731237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b8bc-e005-4df8-87ef-5645ca23c4a9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:06.768842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.056920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.056920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.056920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.056920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.059016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b6c0a-779c-4dc6-b0f0-bd326b2f4efb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.059016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.059016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.059016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.062324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.062324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.062324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.062324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 812/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:07.063779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:07.075540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.078615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.099867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 824/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:07.411364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.454862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:07.478029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fdc5-8353-4cb7-98ae-7c5dadd4e9e8 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.501808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.502326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.503127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.505840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.533394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:07.602719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cb93-5071-4ab7-8d20-0d8af661a78e service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:07.618937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:07.620383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:07.620868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:07.621274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] PATH_INFO: `/v3/users/af18a3bbb47c47019225b7cf7d30d1c9` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:07.623331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af18a3bbb47c47019225b7cf7d30d1c9)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.625934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.666835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:07.680788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6f2e-5ec0-41a3-9a3d-1a69183052bd service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:07.708205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 825/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:07.985971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af18a3bbb47c47019225b7cf7d30d1c9'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:07.986660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af18a3bbb47c47019225b7cf7d30d1c9'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:07.998716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af18a3bbb47c47019225b7cf7d30d1c9'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.089445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af18a3bbb47c47019225b7cf7d30d1c9'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.090326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af18a3bbb47c47019225b7cf7d30d1c9'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.134594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 813/1638] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:07 2022] DELETE /identity/v3/users/af18a3bbb47c47019225b7cf7d30d1c9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:08.140739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.140739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.140978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.181832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:08.182851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.287103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 826/1639] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:08.312769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.312769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.449183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99776d0-e1ca-4b82-9fe7-2b4a3f3cd256 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.463540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.464452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.465750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.466166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.497372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.500247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bdc6d-2704-4437-a8fc-bda9f319d7fa service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.537007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 814/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:09.516445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:09.518956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:09.563611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6a2c-2269-4086-983c-40233932baf4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:09.583488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:09.584342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:09.584622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:09.584919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] PATH_INFO: `/v3/projects/1250f87a21d14229a7076f0bf5b57b1d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:09.590909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1250f87a21d14229a7076f0bf5b57b1d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:09.593098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:09.795962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1250f87a21d14229a7076f0bf5b57b1d', 'request_id': 'req-919844c5-868a-45a4-a104-a918c516c4a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.804522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1250f87a21d14229a7076f0bf5b57b1d', 'request_id': 'req-919844c5-868a-45a4-a104-a918c516c4a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.812254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1250f87a21d14229a7076f0bf5b57b1d', 'request_id': 'req-919844c5-868a-45a4-a104-a918c516c4a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.894466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:09.904071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] The token cache is being invalidate because project 1250f87a21d14229a7076f0bf5b57b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:09.904587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.906241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-919844c5-868a-45a4-a104-a918c516c4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.910930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 827/1641] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:09 2022] DELETE /identity/v3/projects/1250f87a21d14229a7076f0bf5b57b1d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:09.916272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5674-08ed-4276-af53-c585d375720b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:09.917228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5674-08ed-4276-af53-c585d375720b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:09.917710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5674-08ed-4276-af53-c585d375720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:09.965094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-13ed5674-08ed-4276-af53-c585d375720b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:09.967185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-13ed5674-08ed-4276-af53-c585d375720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:10.098169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:10.115951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 815/1642] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:10.124515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.124842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.125336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.183538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:10.184900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:10.222072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 828/1643] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:10.223231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5674-08ed-4276-af53-c585d375720b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.236239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5674-08ed-4276-af53-c585d375720b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.243921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.244964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.245383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.245796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.246760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:10.247185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.249739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.264223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 816/1644] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:10.269335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.287664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6bec-0a98-4541-a67e-c83b30e44414 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.302684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.303324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.303609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.303883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.304710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.307369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.456218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.460374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 829/1645] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:10 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:10.460528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:10.462239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.480935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b147ad9-3777-4de0-b1bb-f6525c819777 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.621907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865d7c-4d76-4610-85de-6fcdcc72fc7f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.629190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.630119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.630541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.630955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] PATH_INFO: `/v3/users/aa0732d3aa3b432c809f2245aff27805` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.645949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0732d3aa3b432c809f2245aff27805)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.652976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.657637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.659541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.662710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.663141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.667985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.677830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.862469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 830/1646] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:10 2022] POST /identity/v3/users => generated 286 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:10.863493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.892708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a735-0b4f-4489-8853-6736c0afe8e0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.916561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.917489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.921293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.921293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.921293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.922588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:10.953243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0732d3aa3b432c809f2245aff27805'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.953755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 831/1647] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:10.954521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0732d3aa3b432c809f2245aff27805'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.955510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:10.974675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0732d3aa3b432c809f2245aff27805'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:10.977147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af305c1-62ab-4405-97b8-16b61f321515 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:10.994213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:10.994927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:10.995273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:10.995615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:10.996330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:10.998230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.078280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 832/1648] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:11.081107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0732d3aa3b432c809f2245aff27805'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:11.081853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43c65c0b-8d63-4129-aaef-9713d14e8825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0732d3aa3b432c809f2245aff27805'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:11.082223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.085240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:11.123241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5a2d-8a3d-4396-8c57-8d7c7d66e799 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.135288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 817/1649] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:10 2022] DELETE /identity/v3/users/aa0732d3aa3b432c809f2245aff27805 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:11.140306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.141081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.143821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.149426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.150119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.150396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.150666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] PATH_INFO: `/v3/projects/319ab902c79648f188a07f2461f94ef7/users/e3f5e71b292046579e3d678b71bfd453/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.201292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=319ab902c79648f188a07f2461f94ef7, user_id=e3f5e71b292046579e3d678b71bfd453, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.207428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:11.209820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:11.215737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ab8f-5e3c-4ea8-b0db-93558f542c0c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.305229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 833/1650] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:11 2022] PUT /identity/v3/projects/319ab902c79648f188a07f2461f94ef7/users/e3f5e71b292046579e3d678b71bfd453/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:11.322234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.322799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.324107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.360575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 818/1651] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:11.374645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.378229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:11.392158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] MFA Rules not processed for user `e3f5e71b292046579e3d678b71bfd453`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:11.408215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:11.520018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 834/1652] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:11.524522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.529548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ff5b-f4f0-40aa-a540-6ca510c0b17a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.658028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.658798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.659163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.659644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.706564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b0e2-628d-4fd5-8f58-98e1d2dbfa19 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:11.726272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:11.726953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:11.727375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:11.733911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:11.733911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.733911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.824931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:11.826414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:11.849446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:11.851437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 819/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:11.861573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 835/1654] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/projects => generated 371 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:11.866368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:11.903625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b21-8c51-46c1-8e35-5dcc26e78b50 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.021387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.022808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.022808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.022808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.023191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.025331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:12.196920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:12.212371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 820/1655] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:11 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:12.214893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054cf4-e44a-48ce-868c-da88f0fb372e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.249316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.249316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.249316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.249316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.249726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.249726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:12.290300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:12.298956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 836/1656] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:12.304406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feaa67-e6ac-4ced-9004-f212e6f4f27e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.315441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.316322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.316897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.317348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] PATH_INFO: `/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf/users/1c9b25c183df489e83f995a7aeba9fd3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.379567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fd0cb6746f4cd6a68e0fa271d42dbf, user_id=1c9b25c183df489e83f995a7aeba9fd3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.382818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:12.667227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 821/1657] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:12 2022] PUT /identity/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf/users/1c9b25c183df489e83f995a7aeba9fd3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:12.671104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:12.678320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:12.686798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08e9-8196-4d0e-a67e-55cf6dbc31f1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.872767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.874069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.874820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.875306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.876810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.878728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b7c9-b6fb-4434-9acf-b2f1aa09b8c9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:12.921640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:12.922015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 837/1658] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:12.943980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15200b1-405d-4ef0-8e9e-9258a406a4af admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:12.970975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:12.972728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:12.973168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:12.973777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] PATH_INFO: `/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf/users/1c9b25c183df489e83f995a7aeba9fd3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:12.976367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fd0cb6746f4cd6a68e0fa271d42dbf, user_id=1c9b25c183df489e83f995a7aeba9fd3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:12.979394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.006775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 822/1659] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:12 2022] PUT /identity/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf/users/1c9b25c183df489e83f995a7aeba9fd3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:13.020039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.020448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.020852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.096776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] MFA Rules not processed for user `1c9b25c183df489e83f995a7aeba9fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:13.098082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:13.357262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 838/1660] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:13.368981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:13.371929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:13.517919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a401b75-a255-4d22-978c-ee33cc1255d2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:13.529685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:13.530375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:13.530664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:13.530922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:13.575943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:13.584913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404760-00dd-4f7a-a6c6-9296b543c64e service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:13.600530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 823/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:13.660880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:14.071399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.074264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.239386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a4ec1-3c8f-4247-a10e-1047deb69a20 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:14.246098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:14.247046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.247495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.247930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] PATH_INFO: `/v3/projects/f714e538a7cf4854adb26d5ca304f5b5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.250420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f714e538a7cf4854adb26d5ca304f5b5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:14.255464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:14.410418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f714e538a7cf4854adb26d5ca304f5b5', 'request_id': 'req-2e05023b-a88e-4f18-85cc-c641124e487f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:14.428092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f714e538a7cf4854adb26d5ca304f5b5', 'request_id': 'req-2e05023b-a88e-4f18-85cc-c641124e487f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:14.452518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f714e538a7cf4854adb26d5ca304f5b5', 'request_id': 'req-2e05023b-a88e-4f18-85cc-c641124e487f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:14.563719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] The token cache is being invalidate because project f714e538a7cf4854adb26d5ca304f5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:14.564060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:14.566037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2e05023b-a88e-4f18-85cc-c641124e487f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:14.571508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 839/1662] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:14 2022] DELETE /identity/v3/projects/f714e538a7cf4854adb26d5ca304f5b5 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:14.573702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.574165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.574342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.656949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.658185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.730171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:14.832429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 824/1663] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.841462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.841862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.842142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.895499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:14.896861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:14.914578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 840/1664] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:14.920845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.939406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f182d-e46c-4cea-ba3e-be8c9bcdae32 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:14.948011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:14.949085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:14.949668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:14.950074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:14.951042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:14.951493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:14.954033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:14.979789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 825/1665] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:14.983880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:14.996862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afbe5-ddff-4e60-bfed-99517fa20e09 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.008883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.009876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.010478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.010898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.011723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.013999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f0b65-4784-402d-bac3-32736b4ae9c5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.140731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 841/1666] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:14 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:15.144476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.164988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a782-aeb0-4bd8-968a-33f31870cbac admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.215040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cbf1-e2e8-46a9-96dd-2d866cd221ee None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.215325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cbf1-e2e8-46a9-96dd-2d866cd221ee None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.215601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cbf1-e2e8-46a9-96dd-2d866cd221ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.291275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-fba4cbf1-e2e8-46a9-96dd-2d866cd221ee None None] MFA Rules not processed for user `bd2a46a3fc3c44779e324d28070fb17e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:15.295894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-fba4cbf1-e2e8-46a9-96dd-2d866cd221ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.319871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.320711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.321263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.321688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.322609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.324717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.430940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 826/1667] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:15 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:15.432079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.457360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09a30-1637-4dac-a97f-417c2723061f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.467975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:15.482713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.484375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.484760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.485396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.486075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.499321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.507164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 842/1668] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:15.517712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.518572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.519179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.539103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 827/1669] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:15.545252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.566536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] MFA Rules not processed for user `bd2a46a3fc3c44779e324d28070fb17e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:15.567191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.578332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdba6-416b-4ef6-8227-6fc2fd8e15ab admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.591214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.592081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.592619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.593065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.593908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.595731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.597451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 843/1670] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:15.612347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.613242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.621069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 828/1671] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:15.633595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.644505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc1f3c-0e29-4cd5-a89f-59efce81cde9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.661722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.667757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.668052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.668336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] PATH_INFO: `/v3/projects/a5c1faba8e58414c9d299576eaa84bbe/users/f67d8180102b40bbab5758139635dc2c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.723564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c1faba8e58414c9d299576eaa84bbe, user_id=f67d8180102b40bbab5758139635dc2c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.728537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a2af-e2c3-4fff-a64d-abb5d8de625f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.754597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b7360-49fc-4bf7-a3f3-d049d15a4590 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.763883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.764906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.765333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.765905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.781741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.783753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:15.806050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 844/1672] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:15.826049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:15.827267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:15.828613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.832988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 829/1673] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:15 2022] PUT /identity/v3/projects/a5c1faba8e58414c9d299576eaa84bbe/users/f67d8180102b40bbab5758139635dc2c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:15.845170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.846604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.846604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.853158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117703ae-73dd-4834-a028-6858c3e7c487 service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:15.909779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] MFA Rules not processed for user `f67d8180102b40bbab5758139635dc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:15.910483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:15.931395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:15.932323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:15.932608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:15.932930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] PATH_INFO: `/v3/users/e3f5e71b292046579e3d678b71bfd453` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:15.934310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f5e71b292046579e3d678b71bfd453)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:15.935546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: WARNING py.warnings [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:15.935546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: warnings.warn(msg) Aug 30 14:56:15.935546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: Aug 30 14:56:15.937349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.035326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 830/1674] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:16.036514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.072184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2742890-0390-4e6a-9389-bdd82aba9ff7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.083515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.085019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.086128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.086620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.088820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.091249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.206223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f5e71b292046579e3d678b71bfd453'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:16.244769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f5e71b292046579e3d678b71bfd453'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:16.249362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 831/1675] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:16.254275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.270955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f5e71b292046579e3d678b71bfd453'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:16.272043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f5e71b292046579e3d678b71bfd453'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:16.272879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba50ecc-53f0-488a-bb69-2017dbb523d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f5e71b292046579e3d678b71bfd453'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:16.419608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e31c6-2a4e-46be-8068-bd95258d59bf admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.422559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 845/1676] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:15 2022] DELETE /identity/v3/users/e3f5e71b292046579e3d678b71bfd453 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:16.428084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.429002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.429390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.494142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:16.495799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.498138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.499124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.499564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.499987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.500864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.503848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.514137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 846/1677] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:16.539925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.542215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.636013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2838f9c-b277-4764-80a0-6dd06c355a69 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.640142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.640796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.641076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.641348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.657132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 832/1678] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:16 2022] POST /identity/v3/users => generated 296 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:16.663325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.669394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.670918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.680399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.706015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 847/1679] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:16.746395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a9a6-89d0-4087-af05-b7fbaac93b34 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.760266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.760929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.761217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.761493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.762159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.763800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3edea-a3dc-4bd6-8c0d-49c8e575ed41 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.799782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 833/1680] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:16.801337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.816416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3cc3c-d5a1-4a78-987b-cb94f3e9d248 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.819371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cece-fff9-4a95-a35b-e719eee84bb8 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.819851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cece-fff9-4a95-a35b-e719eee84bb8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.820271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cece-fff9-4a95-a35b-e719eee84bb8 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.822411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 834/1681] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 14:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:16.827677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.828149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.828567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.842984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.844906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.845835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.846122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] PATH_INFO: `/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa/users/f9ffdcf2d5bb4d428211653ca2e5bff5/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:16.902905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9477a74c7947aa9a06a0ea134f16aa, user_id=f9ffdcf2d5bb4d428211653ca2e5bff5, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:16.910252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:16.917366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:16.918619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:16.937677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 835/1682] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:16.960126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:16.970846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd951f-dc5c-42cc-bedf-2c7b2676d497 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:16.979532 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:16.980536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:16.980991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:16.984607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.000949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.003928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.014054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 836/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:17.050149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 848/1684] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:16 2022] PUT /identity/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa/users/f9ffdcf2d5bb4d428211653ca2e5bff5/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:17.057616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.076388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdd15b-0f75-430c-99dc-5271c0a615ca service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.197332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.197972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.199334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.201458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.202178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.208862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e185-48aa-4385-8412-4e0ad860f73d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.255120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 837/1685] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:17.257202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.269580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6b30e-055b-4c92-850b-de7adb2e10b0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.277008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.277946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.278447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.279141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] PATH_INFO: `/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa/users/f9ffdcf2d5bb4d428211653ca2e5bff5/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.281496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9477a74c7947aa9a06a0ea134f16aa, user_id=f9ffdcf2d5bb4d428211653ca2e5bff5, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.291035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.324516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.325020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.325469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.328274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 849/1686] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:17 2022] PUT /identity/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa/users/f9ffdcf2d5bb4d428211653ca2e5bff5/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:17.384052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:17.390713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] MFA Rules not processed for user `f9ffdcf2d5bb4d428211653ca2e5bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:17.393822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.556297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:17.573996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 838/1687] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:17.586071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.588857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.707547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ba1e8-2244-4fa3-bb2d-a867b5f1b31a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.715021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.715865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.716439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.717449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.739101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.739101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:17.740810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:17.743939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:17.782001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 850/1688] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:17.857123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07edc5-8998-4325-9cb2-62a50aa35be8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:17.864228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:17.865715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:17.866117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:17.866469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] PATH_INFO: `/v3/projects/319ab902c79648f188a07f2461f94ef7` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:17.867880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=319ab902c79648f188a07f2461f94ef7)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:17.869110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: WARNING py.warnings [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:56:17.869110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: warnings.warn(msg) Aug 30 14:56:17.869110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: Aug 30 14:56:17.874132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.032005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.034353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.094817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319ab902c79648f188a07f2461f94ef7', 'request_id': 'req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.130587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319ab902c79648f188a07f2461f94ef7', 'request_id': 'req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.181641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319ab902c79648f188a07f2461f94ef7', 'request_id': 'req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.268775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614ade-3cc8-49a0-9a0f-8359b048aaa5 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.343753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] The token cache is being invalidate because project 319ab902c79648f188a07f2461f94ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:18.344148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.350550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:18.355569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 839/1689] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:17 2022] DELETE /identity/v3/projects/319ab902c79648f188a07f2461f94ef7 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:18.355569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.358989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.429891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.430750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.432881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.433841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.444121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.486070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.488606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa0af9-e06c-46dd-a1ce-e050d2cb1dee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.488759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdde3-b3a2-430e-959d-d0adb470ddf3 service placement] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.492618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.493255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.493538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.493815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.495757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.523440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 851/1690] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:18.526482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.528298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.528703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.581072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] MFA Rules not processed for user `bd2a46a3fc3c44779e324d28070fb17e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:18.584639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.620869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.622354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:18.657638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 840/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:18.660198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:18.666367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:18.719145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 852/1692] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:18.806886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:18.925762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920e17-e17b-4788-b723-74005d922e1c service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:18.949100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:18.949935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:18.950822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:18.954705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:18.959954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] PATH_INFO: `/v3/users/1c9b25c183df489e83f995a7aeba9fd3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:18.959954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9b25c183df489e83f995a7aeba9fd3)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:18.960200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.199988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:19.201714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.253759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc9ea-5723-4fdd-98fe-68827213bf76 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:19.275921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:19.276599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.277163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.281683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] PATH_INFO: `/v3/users/9cfc4fc898724458af2dea8ab046a98c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.288443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfc4fc898724458af2dea8ab046a98c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:19.295032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:19.295629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9b25c183df489e83f995a7aeba9fd3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.308248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9b25c183df489e83f995a7aeba9fd3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.322266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9b25c183df489e83f995a7aeba9fd3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.442027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9b25c183df489e83f995a7aeba9fd3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.443005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f14245cc-6e4b-4fbd-b380-068068deaf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9b25c183df489e83f995a7aeba9fd3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.474687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 841/1693] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:18 2022] DELETE /identity/v3/users/1c9b25c183df489e83f995a7aeba9fd3 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:19.550401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfc4fc898724458af2dea8ab046a98c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.614444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfc4fc898724458af2dea8ab046a98c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.639589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfc4fc898724458af2dea8ab046a98c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.640633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfc4fc898724458af2dea8ab046a98c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.641456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfc4fc898724458af2dea8ab046a98c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:19.768395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 853/1694] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:19 2022] DELETE /identity/v3/users/9cfc4fc898724458af2dea8ab046a98c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:19.773426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:19.774973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:19.774973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:19.816543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:19.832642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:19.952877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 842/1695] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:20.092353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:20.094899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:20.300915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d5292-bdda-4574-8fa3-08664f71396f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:20.326829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:20.330742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:20.330742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:20.330742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:20.351691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:20.358053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0eb70-ee4a-4a8e-805f-3d245b6ed74c service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:20.385984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 854/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:20.492308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:21.340464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:22.565939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:22.568491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:22.595244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0335c6-5a68-4ca1-aa5c-28ac158d3d02 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:22.610157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:22.610860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.611200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.615483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] PATH_INFO: `/v3/projects/84414a79400545ce8537afb86eaa740d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.616911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=84414a79400545ce8537afb86eaa740d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:22.637990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:22.671038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:22.937757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e585-7b8d-42b9-b828-370c0d952d71 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:22.938335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e585-7b8d-42b9-b828-370c0d952d71 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:22.938335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e585-7b8d-42b9-b828-370c0d952d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:22.952563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84414a79400545ce8537afb86eaa740d', 'request_id': 'req-28395a87-d312-4588-a2e1-7f3d3ab667fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.966785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84414a79400545ce8537afb86eaa740d', 'request_id': 'req-28395a87-d312-4588-a2e1-7f3d3ab667fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:22.979140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84414a79400545ce8537afb86eaa740d', 'request_id': 'req-28395a87-d312-4588-a2e1-7f3d3ab667fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.046635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f8e9e585-7b8d-42b9-b828-370c0d952d71 None None] MFA Rules not processed for user `cd84bac34f7e40449b1ed0caa7fa4fec`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.050325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f8e9e585-7b8d-42b9-b828-370c0d952d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.103059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] The token cache is being invalidate because project 84414a79400545ce8537afb86eaa740d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:23.103481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.105168 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.111118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 843/1697] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:22 2022] DELETE /identity/v3/projects/84414a79400545ce8537afb86eaa740d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:23.111118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.113435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.232422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 855/1698] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:23.232422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcff7f-8c68-4706-af2f-2b3fcc7723bf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.232422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcff7f-8c68-4706-af2f-2b3fcc7723bf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.232422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcff7f-8c68-4706-af2f-2b3fcc7723bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.305083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c8fcff7f-8c68-4706-af2f-2b3fcc7723bf None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.314916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c8fcff7f-8c68-4706-af2f-2b3fcc7723bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.340414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28395a87-d312-4588-a2e1-7f3d3ab667fa admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.351139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.351808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.352332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.352332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] PATH_INFO: `/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.365482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fd0cb6746f4cd6a68e0fa271d42dbf)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.367478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.452161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 856/1699] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:23.452161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9b0a-2e38-4d0a-a958-6abf00089b77 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.452161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9b0a-2e38-4d0a-a958-6abf00089b77 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.452494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9b0a-2e38-4d0a-a958-6abf00089b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.524454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-36ea9b0a-2e38-4d0a-a958-6abf00089b77 None None] MFA Rules not processed for user `cd84bac34f7e40449b1ed0caa7fa4fec`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.527524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-36ea9b0a-2e38-4d0a-a958-6abf00089b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.547384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 857/1700] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:23.549581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.554914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.555532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.625305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.627702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.631995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fd0cb6746f4cd6a68e0fa271d42dbf', 'request_id': 'req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.667955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fd0cb6746f4cd6a68e0fa271d42dbf', 'request_id': 'req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.690377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fd0cb6746f4cd6a68e0fa271d42dbf', 'request_id': 'req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.763727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 858/1701] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:23.765427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.766847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.801579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] The token cache is being invalidate because project 09fd0cb6746f4cd6a68e0fa271d42dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:23.802097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.803745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:23.813308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 844/1702] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:23 2022] DELETE /identity/v3/projects/09fd0cb6746f4cd6a68e0fa271d42dbf => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:23.815085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:23.820893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.853058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d53d-0f2b-4fa9-a296-4a8f17f57f2e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.869286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.869917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.870198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.870473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.871137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:23.871599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:23.873641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dea26-3a1d-4175-b073-ee7cc51cedd5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:23.891346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 845/1703] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:23.893238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0637-b538-4cf3-885b-f5ee342a1b9e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.893982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0637-b538-4cf3-885b-f5ee342a1b9e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.893982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0637-b538-4cf3-885b-f5ee342a1b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.934228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133fb52-e68f-4d16-bd1c-3457bef200bd None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:23.953450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:23.956032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:23.956530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:23.956871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:23.964013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:23.980274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-180a0637-b538-4cf3-885b-f5ee342a1b9e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:23.983039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-180a0637-b538-4cf3-885b-f5ee342a1b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.003939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:24.006482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 846/1704] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:24.010090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f4e7-5aa9-4f49-aad3-0f964f5ef467 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.013672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f4e7-5aa9-4f49-aad3-0f964f5ef467 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.016935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f4e7-5aa9-4f49-aad3-0f964f5ef467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.086120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f975f4e7-5aa9-4f49-aad3-0f964f5ef467 None None] MFA Rules not processed for user `488eb88e27ed47e7856e999ef96efb69`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:24.088135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f975f4e7-5aa9-4f49-aad3-0f964f5ef467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.148065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.150179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.176613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 859/1705] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:24.177562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.202514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905510-50d5-42ab-a363-03eb58ae26dc service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.213475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.217251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.217251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.217251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.217251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.221426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.248594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 847/1706] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:24.250425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.250746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.251447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.291997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:24.294862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:24.315759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 848/1707] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:24.318319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.355678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8bbc-e86d-48d6-8e28-e01b986905e0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.368962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.370037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.370037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.370559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.371402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:24.371840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.375323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.398119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 860/1708] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/projects => generated 405 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:24.410597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.416980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 849/1709] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:24.418303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.430536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580ea-5f33-4103-abbd-f87d5077dd13 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.601358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.602259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.602765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.603258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.604114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.606739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364a51b-4b18-425d-bf9f-08c6c4c08327 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.637020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28abc4-53f8-431c-b103-a4e5d0715670 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.654291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:24.655002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.655205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.656273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.656852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:24.662948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:24.663879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:24.725153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 850/1710] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/projects => generated 357 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:24.727943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:24.728916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:24.730196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:24.809404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 861/1711] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/users => generated 303 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:24.810238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:24.841824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701eea-dbf9-45be-9705-6ebb63bd7365 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:24.857992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:24.910967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:24.914673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.013483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.014110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.014608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.016253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.017108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.023167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.165073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 851/1712] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:25.165961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.168177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.193076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 862/1713] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:24 2022] POST /identity/v3/users => generated 279 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:25.195521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.232463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc312562-eaf8-4dd9-a3ba-8975d1b3ed18 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.245180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.246331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.246801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.247261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.248114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.249959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.268027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 863/1714] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:25.269048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.286952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684e111-8c67-4724-9505-45a29a29a96f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.294433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.295390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.295865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.296994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.298187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.302602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.305025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b200bf-c15c-49b5-9029-a6a0c93f394a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.312026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.312693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.312974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.313249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.321438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 864/1715] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:25.322686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.353232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999007e-8a02-4d7a-aab1-9b9298edee46 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.364222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.365035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.365384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.365774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.366613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.368960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.387311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 865/1716] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:25.387311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.416785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e7f91-5c7f-4d2e-8942-ac68edf6ce64 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.443873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.448848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.449488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.450223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.451793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.453999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.456566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.458799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.472931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 852/1717] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:25.473943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.476859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 866/1718] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:25.497969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5cbe-4c70-4cde-a072-d434276e2c67 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.499694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.513855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.516574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.516812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.517082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] PATH_INFO: `/v3/projects/55ce4d3d0d154801a719d834e7871b53/users/c4b29e8ebbad4a1cb56cb12e1f224858/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.539959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b6173-8628-4420-ae28-5e22f975f445 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:25.553612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:25.555111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.555396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.555673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] PATH_INFO: `/v3/projects/6500dfb1269c4734b2f0bd784267dd91/users/6e35757b8f8f436aaf5b536aff193686/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.601556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6500dfb1269c4734b2f0bd784267dd91, user_id=6e35757b8f8f436aaf5b536aff193686, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.609295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455f33a-c01e-4676-9329-202eac710437 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.615547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce4d3d0d154801a719d834e7871b53, user_id=c4b29e8ebbad4a1cb56cb12e1f224858, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:25.625525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548c7f-def8-4e08-bc5f-c01a38e8f8fa admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:25.753341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 867/1719] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:25 2022] PUT /identity/v3/projects/6500dfb1269c4734b2f0bd784267dd91/users/6e35757b8f8f436aaf5b536aff193686/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:25.764513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.765104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.780740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.814184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 853/1720] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:25 2022] PUT /identity/v3/projects/55ce4d3d0d154801a719d834e7871b53/users/c4b29e8ebbad4a1cb56cb12e1f224858/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:25.816038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:25.816492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:25.816946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:25.819613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] MFA Rules not processed for user `6e35757b8f8f436aaf5b536aff193686`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:25.821033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.890425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:25.898580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:25.959212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 868/1721] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:25.962489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:25.965701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.021183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 854/1722] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:26.022427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.046721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7779b-994f-4360-8626-b32d97626b2d None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.068060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.069167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.069594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.070003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.070790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.075968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.103790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:26.172453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168a0b4-1f8d-484b-92c5-14484e80d052 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.188687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.188687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.188687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.188687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.256713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 855/1723] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:26 2022] POST /identity/v3/projects => generated 355 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:26.258053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.261067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.334883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.339022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.358928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 869/1724] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:56:26.361203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.390562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0825-24ec-4e33-8b7f-3c79634bf89c service swift] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.406571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1607c2-ae7e-492c-9c6f-221fb941c510 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.417925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.418708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.419726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.420384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.537463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.539484 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.540984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.541365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.542193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.546004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6659c-3a5d-4673-82e9-36e4c5dce0f7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.579359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.581987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.605275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 856/1725] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:26.733722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 870/1726] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:26 2022] POST /identity/v3/users => generated 284 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:26.736458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.751218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec515-6c69-4e71-8272-8163ddcbab8c service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.759985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.761333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.762008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.762632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.763691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.766837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:26.787852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 857/1727] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:26.790761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e67d-6890-4a57-98ff-25ce9f1e0a30 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.791436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e67d-6890-4a57-98ff-25ce9f1e0a30 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.792054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e67d-6890-4a57-98ff-25ce9f1e0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.807158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:26.877655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcdc85-a92b-462c-a18a-170b7e75035d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:26.903758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:26.908467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:26.908944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:26.909134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] PATH_INFO: `/v3/projects/9487bc2383fe484da1a1a87f1700e234/users/1700bc4562d64efdb7c10555c56b50bf/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:26.952370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7360e67d-6890-4a57-98ff-25ce9f1e0a30 None None] MFA Rules not processed for user `a5bf32548bcb4aea809e2561ba2b2f82`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:26.959337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7360e67d-6890-4a57-98ff-25ce9f1e0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:26.981671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9487bc2383fe484da1a1a87f1700e234, user_id=1700bc4562d64efdb7c10555c56b50bf, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:26.994084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.233348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 858/1728] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:26 2022] PUT /identity/v3/projects/9487bc2383fe484da1a1a87f1700e234/users/1700bc4562d64efdb7c10555c56b50bf/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:27.233348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.291827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 871/1729] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:27.316635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3376a2-5aad-44ad-9e43-24d43cccee0b None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.317610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3376a2-5aad-44ad-9e43-24d43cccee0b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.317610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3376a2-5aad-44ad-9e43-24d43cccee0b None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.318702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 872/1730] 10.222.0.13 () {54 vars in 912 bytes} [Tue Aug 30 14:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:27.335027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467a6b-68de-4fa0-89a6-78f4bcacbfaa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.337607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467a6b-68de-4fa0-89a6-78f4bcacbfaa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.337742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467a6b-68de-4fa0-89a6-78f4bcacbfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.338938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:27.427369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-15467a6b-68de-4fa0-89a6-78f4bcacbfaa None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:27.428715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-15467a6b-68de-4fa0-89a6-78f4bcacbfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:27.504059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584078-896d-48b9-8c78-f577e8c0bf6f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.515062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.515690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.515964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.516228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.520185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.524207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.566002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 859/1731] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:27.566973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.574477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 873/1732] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:27.601232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28704f-a263-40d1-a153-965f07016cc2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.630345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.631199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.631484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.631760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] PATH_INFO: `/v3/projects/9487bc2383fe484da1a1a87f1700e234/users/1700bc4562d64efdb7c10555c56b50bf/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.640927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9487bc2383fe484da1a1a87f1700e234, user_id=1700bc4562d64efdb7c10555c56b50bf, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.649416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.696306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 860/1733] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:27 2022] PUT /identity/v3/projects/9487bc2383fe484da1a1a87f1700e234/users/1700bc4562d64efdb7c10555c56b50bf/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:27.698128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.698589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.699143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.707190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.758572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] MFA Rules not processed for user `1700bc4562d64efdb7c10555c56b50bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:27.760001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:27.908933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40c2d2-fd26-4e07-b8c8-c13913980e86 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:27.908933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:27.908933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:27.908933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:27.910574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:27.940792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:27.942406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:27.966958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 874/1734] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:27.978241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:27.980707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:28.056598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 861/1735] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:28.069904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:28.075450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:28.114464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea731-4c9f-46e1-94d3-e47eed534702 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:28.119403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:28.120648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.121126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.121555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.159624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:28.162786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303505-bfad-40d6-87f4-93de700e8a19 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:28.241999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 875/1736] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:28.285419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.285568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.285830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.373458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:28.374736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:28.383264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 876/1737] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 30 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:28.518156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f4ee3-71a1-4109-bb71-527e45f780e2 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:28.550284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:28.550953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.551229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.551499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.564191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:28.576451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667efe-09e3-41f8-91fe-26f00b7bea04 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:28.609221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:28.609857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.610140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.610416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.669926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:28.671475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:28.718165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 877/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:28.719091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:28.722286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:28.782354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97874c2-fe93-4d07-aedc-6a7198d418e0 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:28.808876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:28.808876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:28.808876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:28.808876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:28.907218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:28.919584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:28.957965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 862/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:29.026100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:29.033996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db71b-5ed2-45a3-bd40-53e0997d2196 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:29.068915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 878/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:30.784180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:30.898855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:32.592347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:32.596265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:32.713977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4526e-ad35-4f3a-95f5-5c9562840065 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:32.722855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:32.726610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:32.726610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:32.737499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] PATH_INFO: `/v3/users/f67d8180102b40bbab5758139635dc2c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:32.739381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67d8180102b40bbab5758139635dc2c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:32.743087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:33.197811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67d8180102b40bbab5758139635dc2c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:33.201616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67d8180102b40bbab5758139635dc2c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:33.230281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67d8180102b40bbab5758139635dc2c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:33.484875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67d8180102b40bbab5758139635dc2c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:33.487135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-95590c40-cb9a-49f4-a7d3-8d50c4d0e062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67d8180102b40bbab5758139635dc2c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:33.564699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97795aa-79b5-46a7-892b-92ad5f2fdd6f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:33.564699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97795aa-79b5-46a7-892b-92ad5f2fdd6f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:33.564699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97795aa-79b5-46a7-892b-92ad5f2fdd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:33.565704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 863/1741] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:32 2022] DELETE /identity/v3/users/f67d8180102b40bbab5758139635dc2c => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:33.621901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e97795aa-79b5-46a7-892b-92ad5f2fdd6f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:33.623142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e97795aa-79b5-46a7-892b-92ad5f2fdd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:33.643048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:33.643628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:33.643723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:33.645139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 864/1742] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:56:33.739718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 879/1743] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:33.750661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:33.754506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:33.814247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e12-27ec-4162-8573-62aed11b8de9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:33.815093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e12-27ec-4162-8573-62aed11b8de9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:33.815647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4e12-27ec-4162-8573-62aed11b8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:33.858423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-76ff4e12-27ec-4162-8573-62aed11b8de9 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:33.865271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-76ff4e12-27ec-4162-8573-62aed11b8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.033187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b568-96f0-4767-947f-04b8ae1ec262 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:34.047140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 880/1744] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:34.052702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:34.053610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.054147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.054370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.068353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:34.072059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe9f4-3cec-4bdc-8478-8bc04635868f service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:34.080932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.084233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.087876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.095626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 881/1745] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:56:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:34.115024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:34.116788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:34.119002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.145655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 865/1746] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:34.147432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.147768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.148083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.171311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f2b3-14f1-420d-9f6c-045b79b8878e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:34.185894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:34.189252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:34.191325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.199943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.200639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.226700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:34.233073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ee28c-6a28-4568-a7c9-97aca9bf5301 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:34.263244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:34.267633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.302079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 882/1747] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:34.317553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 866/1748] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:34.412996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.413288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.413562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.503159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] MFA Rules not processed for user `c4b29e8ebbad4a1cb56cb12e1f224858`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:34.512705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.651674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 883/1749] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:34.653957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:34.655866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:34.673893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:34.685863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7f5b-91f6-4120-a1d4-dd3442bee9b5 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:34.699757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a7f7-be26-4b94-988c-b36ed71149be None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:34.702603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:34.703239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.703577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.703860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.708103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:34.711108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:34.716367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:34.718781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:34.719694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:34.720615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:34.770593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:34.770593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:34.797038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 884/1750] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:34.944340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 867/1751] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:34 2022] POST /identity/v3/projects => generated 405 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:34.951472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:34.991912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689277f-caa2-40d1-b76e-eee5f8f7f747 service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:35.290599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:35.293956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.294383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.294765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.295266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:35.297415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:35.533688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 885/1752] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:34 2022] POST /identity/v3/users => generated 309 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:35.537905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:35.567185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e7ba-bffb-4eec-9360-88500848073a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:35.592141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:35.598050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.598050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.598050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.598050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:35.600204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:35.630240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 868/1753] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:35.634110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:35.648266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25e2e-7483-433f-8abf-8d5583db756c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:35.654769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:35.656260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:35.656794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:35.657359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] PATH_INFO: `/v3/projects/41821f9d4b944e27ae0afe7da770f3d4/users/d2ac9d086dc747dbaf52c087d23b9970/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:35.691126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41821f9d4b944e27ae0afe7da770f3d4, user_id=d2ac9d086dc747dbaf52c087d23b9970, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:35.694800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:35.796530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 886/1754] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:35 2022] PUT /identity/v3/projects/41821f9d4b944e27ae0afe7da770f3d4/users/d2ac9d086dc747dbaf52c087d23b9970/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:35.801846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:35.824957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f319cd-73bc-4470-9a43-a7d1bc6a1d2c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.050923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:36.077561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.078561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.080997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.082073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.083021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.085083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.098468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 869/1755] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:36.102515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.116160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45967c-a9ab-4914-8c78-9dd6426d9c90 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.155436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.167646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.181307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.189373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] PATH_INFO: `/v3/projects/41821f9d4b944e27ae0afe7da770f3d4/users/d2ac9d086dc747dbaf52c087d23b9970/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.198944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41821f9d4b944e27ae0afe7da770f3d4, user_id=d2ac9d086dc747dbaf52c087d23b9970, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.206407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:36.243933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 887/1756] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:36 2022] PUT /identity/v3/projects/41821f9d4b944e27ae0afe7da770f3d4/users/d2ac9d086dc747dbaf52c087d23b9970/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:36.612919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:36.616060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:36.655915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3560d-0e9e-40de-a683-b9ce76497999 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:36.833646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:36.835409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:36.837047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:36.837541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] PATH_INFO: `/v3/projects/a5c1faba8e58414c9d299576eaa84bbe` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:36.841023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c1faba8e58414c9d299576eaa84bbe)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:36.844237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.193740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c1faba8e58414c9d299576eaa84bbe', 'request_id': 'req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.202763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c1faba8e58414c9d299576eaa84bbe', 'request_id': 'req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.209981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c1faba8e58414c9d299576eaa84bbe', 'request_id': 'req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.571418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] The token cache is being invalidate because project a5c1faba8e58414c9d299576eaa84bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:37.571942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.573082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4cc2d6ff-ed94-4372-b41f-7142bb70efcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:37.575663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 870/1757] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:36 2022] DELETE /identity/v3/projects/a5c1faba8e58414c9d299576eaa84bbe => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:37.611655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:37.613955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:37.632222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113013-8fa1-4394-9264-5ac320c8fe2b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:37.741555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:37.743703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.744568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.745161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] PATH_INFO: `/v3/users/f9ffdcf2d5bb4d428211653ca2e5bff5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.747521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ffdcf2d5bb4d428211653ca2e5bff5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:37.754168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:37.805091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b54ccd-3fa1-4957-98d4-8f13d4c75b52 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:37.815500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b54ccd-3fa1-4957-98d4-8f13d4c75b52 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:37.815853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b54ccd-3fa1-4957-98d4-8f13d4c75b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:37.882839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-31b54ccd-3fa1-4957-98d4-8f13d4c75b52 None None] MFA Rules not processed for user `488eb88e27ed47e7856e999ef96efb69`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:37.884103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-31b54ccd-3fa1-4957-98d4-8f13d4c75b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.111096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ffdcf2d5bb4d428211653ca2e5bff5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:38.183257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 871/1758] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:38.186317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:38.187094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ffdcf2d5bb4d428211653ca2e5bff5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:38.189206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:38.190256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:38.225022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ffdcf2d5bb4d428211653ca2e5bff5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:38.227354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ffdcf2d5bb4d428211653ca2e5bff5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:38.228968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-28af2a8c-b7fd-49d6-b1d5-397cf737cbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ffdcf2d5bb4d428211653ca2e5bff5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:38.264726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] MFA Rules not processed for user `a5bf32548bcb4aea809e2561ba2b2f82`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:38.267313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:38.402740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 872/1759] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:38.510792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 888/1760] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:37 2022] DELETE /identity/v3/users/f9ffdcf2d5bb4d428211653ca2e5bff5 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:39.206381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:39.650784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:39.652703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:39.689140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982658b5-5644-4eae-891f-40299e4ec31e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:39.839045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:39.840388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:39.847612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:39.848533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] PATH_INFO: `/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:39.851964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9477a74c7947aa9a06a0ea134f16aa)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:39.855469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.062676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9477a74c7947aa9a06a0ea134f16aa', 'request_id': 'req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.071905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9477a74c7947aa9a06a0ea134f16aa', 'request_id': 'req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.101924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9477a74c7947aa9a06a0ea134f16aa', 'request_id': 'req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.353200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] The token cache is being invalidate because project 7b9477a74c7947aa9a06a0ea134f16aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:40.354316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.355907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-5e7e92cd-750b-4e31-aaad-e6bfd23aa88e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:40.358827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 873/1761] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:39 2022] DELETE /identity/v3/projects/7b9477a74c7947aa9a06a0ea134f16aa => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:40.364953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.365970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.366504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.402133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:40.403355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.489049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 889/1762] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:40.496526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.500439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.500439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.520755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:40.521823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.543428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 874/1763] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:40.549473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.563393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667140-26e1-4a48-b636-ffb05393edb9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.579876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.579876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.579876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.580205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.580770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:40.581129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.583627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ff66-eb94-4ecd-a165-4d92a37f4d3a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.605010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 890/1764] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:40.606451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.626056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.626438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.626996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dc1f1-3557-435f-8e33-405f44d85b45 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.627627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.637676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.639057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.639485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.640390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.641083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.643898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.675489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] MFA Rules not processed for user `d2ac9d086dc747dbaf52c087d23b9970`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:40.677238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:40.722100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 875/1765] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:40.726814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.785003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 891/1766] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:40.794895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:40.839856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8c0f-256c-4dc0-91a8-540ef9992888 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.846625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.847450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.847832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.848223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.849548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.851277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.933642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 876/1767] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:40 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:40.937873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.951928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82dfe-88cb-4178-8e9e-6757f9883d66 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.957884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.966782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.966782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.966782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.966782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.966782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:40.972902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 892/1768] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:40.977397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:40.989343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1427905-a8af-4a49-ad69-355d51b9a9ba admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:40.994896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:40.995501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:40.995781 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:40.996052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:40.996758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:40.998406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6933b7-4621-445a-8657-4a9b671c2f62 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.010346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 877/1769] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:41.014891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.025935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c53ca-5910-4105-a8e6-4399717b0a64 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.030923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.031638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.032629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.033130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] PATH_INFO: `/v3/projects/c72a5311cd084404806af5c8dba8de73/users/78ad0752f6354eab84132f451bf233d1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.051308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72a5311cd084404806af5c8dba8de73, user_id=78ad0752f6354eab84132f451bf233d1, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.054024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.121426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 893/1770] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:41 2022] PUT /identity/v3/projects/c72a5311cd084404806af5c8dba8de73/users/78ad0752f6354eab84132f451bf233d1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:41.133862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.134526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.136575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.170121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] MFA Rules not processed for user `78ad0752f6354eab84132f451bf233d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:41.171346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:41.252698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 878/1771] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:41.258066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.367933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358893f5-ce83-4d19-86f7-0d8727252249 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.372938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.373625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.374015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.374363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.375136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.377822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deba9d-933f-49a1-ae0f-13f8bcce7a94 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.560651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 894/1772] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/projects => generated 363 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:41.567059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.586924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c661-8229-4209-b879-29b42b4e1e22 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.631448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa344-5f1b-4e6b-90c0-8124e7cd2860 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.632149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa344-5f1b-4e6b-90c0-8124e7cd2860 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.632477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa344-5f1b-4e6b-90c0-8124e7cd2860 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.635570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 895/1773] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:56:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:41.716979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.716979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.717159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.717402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.718032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.720060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.763811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43fb4-68c6-4416-80a0-7340b65f1e77 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.764128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43fb4-68c6-4416-80a0-7340b65f1e77 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.764385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43fb4-68c6-4416-80a0-7340b65f1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.812520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-46d43fb4-68c6-4416-80a0-7340b65f1e77 None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:41.816518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-46d43fb4-68c6-4416-80a0-7340b65f1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:41.877020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 879/1774] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:41.880806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.898554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:41.916713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a1309-167d-491b-acbd-4d88b6cb2c73 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:41.939111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:41.939941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:41.940232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:41.940509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:41.941209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:41.946266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:41.971949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 880/1775] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:41.973837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:41.998819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70147b-07ed-478a-a5eb-9c23461ed7b7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.003120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 896/1776] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:42.019797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.027147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0782-5eb2-4cbe-99f0-ce954359631e None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.027147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0782-5eb2-4cbe-99f0-ce954359631e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.027147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0782-5eb2-4cbe-99f0-ce954359631e None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.027147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 897/1777] 10.222.0.13 () {54 vars in 961 bytes} [Tue Aug 30 14:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:42.027483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.027483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.027483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] PATH_INFO: `/v3/projects/a76d3244a63243df86efa20bae146fc1/users/2d3e6a3f9aa64248a7b37ce39b736593/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.029901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02355-8396-4368-91e2-25b7932444db None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.030175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02355-8396-4368-91e2-25b7932444db None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.030452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02355-8396-4368-91e2-25b7932444db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.051646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76d3244a63243df86efa20bae146fc1, user_id=2d3e6a3f9aa64248a7b37ce39b736593, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.055041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.065698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6df02355-8396-4368-91e2-25b7932444db None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:42.067150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6df02355-8396-4368-91e2-25b7932444db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.076971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 898/1778] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Aug 30 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 14:56:42.086124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df02355-8396-4368-91e2-25b7932444db None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.098320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df02355-8396-4368-91e2-25b7932444db None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.104604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.105730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.106771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.107363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.119041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.121168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.144854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 899/1779] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:42.177260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 881/1780] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:41 2022] PUT /identity/v3/projects/a76d3244a63243df86efa20bae146fc1/users/2d3e6a3f9aa64248a7b37ce39b736593/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:42.181588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.196235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63375e7-1aaf-48e8-b9d0-dfd464af18e4 service placement] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.342987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.343872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.344995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.345436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.346169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.348128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c887d2-b0e4-4629-91f2-7c12b58e208a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.368523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.369494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 900/1781] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:42.381394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c06329-64e1-483b-afb6-153e57d16230 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.387637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.388405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.388815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.389160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] PATH_INFO: `/v3/projects/a76d3244a63243df86efa20bae146fc1/users/2d3e6a3f9aa64248a7b37ce39b736593/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.392412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76d3244a63243df86efa20bae146fc1, user_id=2d3e6a3f9aa64248a7b37ce39b736593, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.395438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.407514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 882/1782] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:42 2022] PUT /identity/v3/projects/a76d3244a63243df86efa20bae146fc1/users/2d3e6a3f9aa64248a7b37ce39b736593/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:42.417709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.417996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.418270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.449842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] MFA Rules not processed for user `2d3e6a3f9aa64248a7b37ce39b736593`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:42.452099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.563520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 901/1783] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:42.576185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:42.578072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:42.677931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1294deb-0bba-47ae-90bb-618bfe867bef admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:42.684940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:42.685688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:42.686142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:42.686567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:42.705686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:42.707537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030295-0aff-47ad-8cf8-5457a9198242 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:42.725211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 883/1784] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:42.995713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.006696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d02b25-ee5f-4944-a8d4-c0b949e1180e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.015617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.015617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.015617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.015617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.087082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.088577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2354b-7203-453f-9d06-5b7e76d414e9 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.100250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 902/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:43.475642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91b4e-6b6f-420e-ad5e-69db7c4f373c None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.476198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91b4e-6b6f-420e-ad5e-69db7c4f373c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.476468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91b4e-6b6f-420e-ad5e-69db7c4f373c None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.478019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 884/1786] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:43.513642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.514177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.514177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.560151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] MFA Rules not processed for user `f68cc82482a04e7a9ac920fd7da98e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:43.560151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.652596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 903/1787] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:43.671637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91b4e-6b6f-420e-ad5e-69db7c4f373c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.691611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91b4e-6b6f-420e-ad5e-69db7c4f373c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.694328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.695197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.695618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.696039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.706242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.707964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:43.720031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 885/1788] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:43.847480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:43.848955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:43.905604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:43.963964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14fb9-f021-475d-918e-0bc4d14ed048 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:43.974003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:43.978731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:43.978731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:43.978731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] PATH_INFO: `/v3/users/c4b29e8ebbad4a1cb56cb12e1f224858` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:43.978731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b29e8ebbad4a1cb56cb12e1f224858)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:43.979195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.248043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b29e8ebbad4a1cb56cb12e1f224858'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.260126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b29e8ebbad4a1cb56cb12e1f224858'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.287338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b29e8ebbad4a1cb56cb12e1f224858'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.288427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b29e8ebbad4a1cb56cb12e1f224858'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.289545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b29e8ebbad4a1cb56cb12e1f224858'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.370854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 904/1789] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:43 2022] DELETE /identity/v3/users/c4b29e8ebbad4a1cb56cb12e1f224858 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:44.706566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:44.722562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52550a-a09c-4f6c-956a-ca9937f139e6 service placement] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:44.795283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:44.829735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:44.831005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:44.831295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:44.831579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] PATH_INFO: `/v3/projects/55ce4d3d0d154801a719d834e7871b53` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:44.832865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ce4d3d0d154801a719d834e7871b53)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:44.836562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:44.959708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ce4d3d0d154801a719d834e7871b53', 'request_id': 'req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.965907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ce4d3d0d154801a719d834e7871b53', 'request_id': 'req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:44.973340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ce4d3d0d154801a719d834e7871b53', 'request_id': 'req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.098661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] The token cache is being invalidate because project 55ce4d3d0d154801a719d834e7871b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:45.099518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.102632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.105333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 886/1790] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:44 2022] DELETE /identity/v3/projects/55ce4d3d0d154801a719d834e7871b53 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:45.106422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.108086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.124712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681c98-5718-4ab7-9d2b-2c22c44f6aa7 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:45.223582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:45.224472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:45.224953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:45.225285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] PATH_INFO: `/v3/users/d2ac9d086dc747dbaf52c087d23b9970` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:45.226915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ac9d086dc747dbaf52c087d23b9970)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:45.228934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:45.463300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ac9d086dc747dbaf52c087d23b9970'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.477699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ac9d086dc747dbaf52c087d23b9970'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.487053 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ac9d086dc747dbaf52c087d23b9970'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.488184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ac9d086dc747dbaf52c087d23b9970'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.489048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-251e6087-f064-480a-a663-a3ab5f569c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ac9d086dc747dbaf52c087d23b9970'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:45.620417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 905/1791] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:45 2022] DELETE /identity/v3/users/d2ac9d086dc747dbaf52c087d23b9970 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:45.808001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:45.967399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:45.969005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:45.988643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbb01e-6cc6-4c88-b4a0-600dac2190e1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.092018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.095143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.095680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.096163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] PATH_INFO: `/v3/projects/41821f9d4b944e27ae0afe7da770f3d4` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.098067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41821f9d4b944e27ae0afe7da770f3d4)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.102688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.284006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41821f9d4b944e27ae0afe7da770f3d4', 'request_id': 'req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.292882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41821f9d4b944e27ae0afe7da770f3d4', 'request_id': 'req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.304053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41821f9d4b944e27ae0afe7da770f3d4', 'request_id': 'req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.423216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] The token cache is being invalidate because project 41821f9d4b944e27ae0afe7da770f3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:46.431672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.431672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-436d1fa3-6f22-4048-8495-b52fdeb3f8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:46.431672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 887/1792] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:45 2022] DELETE /identity/v3/projects/41821f9d4b944e27ae0afe7da770f3d4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:46.431963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.431963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.431963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.452363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:46.453999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.540181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 906/1793] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:46.548715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.549002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.549359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.570443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:46.571837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:46.581378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 888/1794] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:46.585164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.595933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825df2a-2bfe-4868-81f9-0202b5f20a64 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.601656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.602467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.602893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.603341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.604164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:46.604689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.606515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.624108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 907/1795] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:46.625064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.635336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e353e-e185-4641-b867-b4cc555b4e79 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.646686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.647947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.650032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.650032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.650032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.652334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:46.810072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 889/1796] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/projects => generated 409 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:46.814193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:46.816821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:46.833008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87a71-a3fc-4f37-80df-3c0a970f993a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:46.909823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:46.911119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:46.911402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:46.911673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:46.914582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:46.914582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.250929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 908/1797] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:46 2022] POST /identity/v3/users => generated 305 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:47.265754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.277098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485dc50-c098-4eab-9b90-e3311ea99025 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.281640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.282238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.282509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.282780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.283422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.285056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.309694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 890/1798] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:47.312422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.326347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785ad8d-2396-4dae-9d76-793de8b8dfce admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.338668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.340483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.341086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.342069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.343056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.345246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.372374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 909/1799] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:47.377225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.392812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.393438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0d6f-7ac7-4c1d-8440-11f3c9b6561a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.396849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.399912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.401735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.402220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.402655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] PATH_INFO: `/v3/projects/75e1eb9d1f144296acc89797f13daba0/users/45f432e512e64d259f8a6bba93918888/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.420765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d35a-1e98-4390-87b8-04cf3ec9bf51 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.424782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e1eb9d1f144296acc89797f13daba0, user_id=45f432e512e64d259f8a6bba93918888, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.427804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a65232-9c28-4f44-9f94-d0114ed04afd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.429687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.430434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.430992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.431543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] PATH_INFO: `/v3/users/78ad0752f6354eab84132f451bf233d1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.433420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ad0752f6354eab84132f451bf233d1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.440375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.515255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 891/1800] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:47 2022] PUT /identity/v3/projects/75e1eb9d1f144296acc89797f13daba0/users/45f432e512e64d259f8a6bba93918888/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:47.540175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.540556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.540858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.577795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] MFA Rules not processed for user `45f432e512e64d259f8a6bba93918888`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:47.592145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.659860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 892/1801] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:47.664059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.697246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ad0752f6354eab84132f451bf233d1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.724782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ad0752f6354eab84132f451bf233d1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.737492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ad0752f6354eab84132f451bf233d1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.739041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ad0752f6354eab84132f451bf233d1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.739760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1747607b-a1ce-484b-97ab-73a0ac9c8ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ad0752f6354eab84132f451bf233d1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:47.775632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119cce-942e-4a54-b557-7b7f6b2c8238 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:47.787796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:47.793090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.793090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.793090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.793090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:47.794235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8713-67ff-43b0-b0d2-8782f208a1ad admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:47.824142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 910/1802] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:47 2022] DELETE /identity/v3/users/78ad0752f6354eab84132f451bf233d1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:47.826574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af03d0-5c2e-45ff-b74f-c82220b18c45 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.827608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af03d0-5c2e-45ff-b74f-c82220b18c45 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.828109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af03d0-5c2e-45ff-b74f-c82220b18c45 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.835020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 911/1803] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:56:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:56:47.838242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.841779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.842069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.903226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:47.904483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:47.985199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 893/1804] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/projects => generated 407 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:47.987222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:47.987609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:47.988000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:47.989916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 912/1805] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:47.991033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:47.992330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.006822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becdcb-ab4b-468c-bafa-36ad0f26a9c0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.038417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:48.044638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.090427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.091291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.091621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.091745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.092422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.094805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.178315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 913/1806] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/users => generated 310 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:48.178315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.178315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.184261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:48.240391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 894/1807] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:48.241376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.264050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753b0f-ad42-494f-bd0d-94100eeaf68b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.277387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.278559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.278838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.279413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.280217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.285615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.310727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 895/1808] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:48.313009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.318292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d6bcf-127d-4f30-a124-8f911b52cbaf admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.323258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.324163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.324521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdaa40-a61c-4eeb-a7b4-08303856c9fb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.324784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.325160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.330840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.332834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.333437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.333844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] PATH_INFO: `/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89/users/8c608bf5b2b4415e8d9f9b8cedcb40c6/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.338243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.339850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.353977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 914/1809] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:48.359202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a41ad9b8074882aafb5f960a7d1b89, user_id=8c608bf5b2b4415e8d9f9b8cedcb40c6, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.364180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.457169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 896/1810] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:48 2022] PUT /identity/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89/users/8c608bf5b2b4415e8d9f9b8cedcb40c6/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:48.463139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.479675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7192-11ae-40ab-84e6-efd70458e59f service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.553125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.554067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.554662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.555131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.556093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.558856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c35ac-418b-4017-8c66-ce931cee8142 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.577887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 915/1811] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:48.579279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.593906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35e63-54df-448c-92d8-4c303f228a25 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.601032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.601725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.602063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.602342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] PATH_INFO: `/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89/users/8c608bf5b2b4415e8d9f9b8cedcb40c6/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.604441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a41ad9b8074882aafb5f960a7d1b89, user_id=8c608bf5b2b4415e8d9f9b8cedcb40c6, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.608170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.622180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 897/1812] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:48 2022] PUT /identity/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89/users/8c608bf5b2b4415e8d9f9b8cedcb40c6/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:48.639813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.639813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.639813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.665284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] MFA Rules not processed for user `8c608bf5b2b4415e8d9f9b8cedcb40c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:48.666527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.782908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.783120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 916/1813] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:48.785902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.876187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:48.877629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:48.884208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:48.892642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaf1c-8054-41c4-a488-1e5c7beb1fbe admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:48.896827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:48.897562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:48.897903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:48.898243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:48.910783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:48.912354 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:48.945123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 898/1814] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:49.032007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab20eb-6907-4183-a132-8794b64c5f87 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.033371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.033996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.034121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.034436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.035006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] PATH_INFO: `/v3/projects/c72a5311cd084404806af5c8dba8de73` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.035654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.036241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72a5311cd084404806af5c8dba8de73)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.038613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.143867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ca57-b91d-49d2-8ca1-1c04ad3ff889 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.149915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.150535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.150812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.151347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.161272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.162865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.174832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 899/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:49.228975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72a5311cd084404806af5c8dba8de73', 'request_id': 'req-6546b6dc-76c8-481d-8177-993ab1e01c5f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.239326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72a5311cd084404806af5c8dba8de73', 'request_id': 'req-6546b6dc-76c8-481d-8177-993ab1e01c5f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.254359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72a5311cd084404806af5c8dba8de73', 'request_id': 'req-6546b6dc-76c8-481d-8177-993ab1e01c5f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.342857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] The token cache is being invalidate because project c72a5311cd084404806af5c8dba8de73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:49.343319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.344427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.346200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 917/1816] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:48 2022] DELETE /identity/v3/projects/c72a5311cd084404806af5c8dba8de73 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:49.350165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.362443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a457-1b56-4bf0-9a22-97d3f8dd4522 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.457517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.457517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.457517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.457517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] PATH_INFO: `/v3/users/2d3e6a3f9aa64248a7b37ce39b736593` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.460355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3e6a3f9aa64248a7b37ce39b736593)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.462866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.511175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:49.512908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.694341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b6dc-76c8-481d-8177-993ab1e01c5f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:49.695559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3e6a3f9aa64248a7b37ce39b736593'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.696587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3e6a3f9aa64248a7b37ce39b736593'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.703846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:49.705824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:49.705824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:49.705824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:49.719801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:49.721982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3e6a3f9aa64248a7b37ce39b736593'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.827895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3e6a3f9aa64248a7b37ce39b736593'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.829541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300ab305-eeb4-4ddf-b26a-b17e5107b06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3e6a3f9aa64248a7b37ce39b736593'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:49.834170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:49.836381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:49.849964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 918/1817] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:49.869896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 900/1818] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:49 2022] DELETE /identity/v3/users/2d3e6a3f9aa64248a7b37ce39b736593 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:50.537387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:50.579724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:50.584208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:50.639597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98831d2-0ef6-4368-8829-1fd62ea66c81 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:50.724248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:50.725166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:50.725584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:50.725993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] PATH_INFO: `/v3/projects/a76d3244a63243df86efa20bae146fc1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:50.731438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76d3244a63243df86efa20bae146fc1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:50.739144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:50.905797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76d3244a63243df86efa20bae146fc1', 'request_id': 'req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:50.915997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76d3244a63243df86efa20bae146fc1', 'request_id': 'req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:50.925928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76d3244a63243df86efa20bae146fc1', 'request_id': 'req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.011916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] The token cache is being invalidate because project a76d3244a63243df86efa20bae146fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:51.012612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.013505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-38f2cd0a-1d9f-4483-af8c-74e9d7feab65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:51.022251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 919/1819] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:50 2022] DELETE /identity/v3/projects/a76d3244a63243df86efa20bae146fc1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:51.023459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.023764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.024102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.053449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:51.055501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.138375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 901/1820] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:51.138549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:51.143978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.144364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.148356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.170616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:51.171826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:51.184556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 920/1821] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:51.186784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.197202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9b36-74db-4b2f-8fab-048cec03c942 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.201824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.202427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.202782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.203052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.205291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:51.205708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.207504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.225047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 902/1822] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:56:51.226101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.235431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab068-f024-47c5-b63f-c8fc2ab8ee82 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.243880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.247452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.248637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.248941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.249617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.251608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.374230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 921/1823] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:51.375554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.389129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c2ed-cc27-465c-8b1f-cf05728e9310 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.507952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.508587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.508907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.509180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.509877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.511981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.628910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 903/1824] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:51.632844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.643105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0050-e620-4150-8243-cabbc8bbed52 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.647680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.648279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.648559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.648867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.649616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.651446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.679336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 922/1825] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:51.680484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.695491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a46a-3a18-4754-83ce-4f351add1ffa admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.700960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.701569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.701847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.702150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.702821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.704548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6df81-606f-4578-ae27-0c7af66ccc7c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.722683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 904/1826] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:51.723836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:51.735958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f2c6-2777-49b7-a0b0-66268dc3bf65 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:51.750771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:51.751451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.751732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.752006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] PATH_INFO: `/v3/projects/3a4f08cb54cf4f98b903e350971fe5ed/users/4bb7bba8c5eb426ba530974e225a7831/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.772245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4f08cb54cf4f98b903e350971fe5ed, user_id=4bb7bba8c5eb426ba530974e225a7831, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:51.778083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:51.890587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 923/1827] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:51 2022] PUT /identity/v3/projects/3a4f08cb54cf4f98b903e350971fe5ed/users/4bb7bba8c5eb426ba530974e225a7831/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:51.901275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:51.901490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:51.901762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:51.934122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] MFA Rules not processed for user `4bb7bba8c5eb426ba530974e225a7831`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:51.935369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.003551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 905/1828] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:52.008195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.095448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc0a3-02c0-4a65-afb0-c47b940e3d3c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.102866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.103488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.103766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.104031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.104862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.107365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.220046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 924/1829] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:52 2022] POST /identity/v3/projects => generated 399 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:52.223498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.234552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f96bd-cd24-42f2-9324-7b2255dfeb34 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.307309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.307908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.308186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.308455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.309130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.311047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.365112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 906/1830] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:52 2022] POST /identity/v3/users => generated 306 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:52.369061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.379553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826383-d9e7-4385-b766-31e83250be5a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.384290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.390280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.390280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.390280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.390280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.390280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.399265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 925/1831] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:52.403666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.414141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc2117-c5ea-4484-81e0-b942b77166ae admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.418858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.419350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.419629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.419905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] PATH_INFO: `/v3/projects/ccae50d6e1594e10b07aebad30e47a0d/users/febe652409544c5d8ec6250399588462/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.436951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccae50d6e1594e10b07aebad30e47a0d, user_id=febe652409544c5d8ec6250399588462, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.440018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.572192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 907/1832] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:52 2022] PUT /identity/v3/projects/ccae50d6e1594e10b07aebad30e47a0d/users/febe652409544c5d8ec6250399588462/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:52.576394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.593514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946368-d7fb-4e33-bdb9-f1833325317b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.649876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.650477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.650738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.651271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.651911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.653556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201dc84-697b-4aae-aebb-f9a655cfe4ef admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.664013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 926/1833] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:52.668270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.679743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811354-4530-44bb-9651-0aec7873a275 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.686341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.687064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.687923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.687923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] PATH_INFO: `/v3/projects/ccae50d6e1594e10b07aebad30e47a0d/users/febe652409544c5d8ec6250399588462/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.689745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccae50d6e1594e10b07aebad30e47a0d, user_id=febe652409544c5d8ec6250399588462, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.694640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:52.703793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 908/1834] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:52 2022] PUT /identity/v3/projects/ccae50d6e1594e10b07aebad30e47a0d/users/febe652409544c5d8ec6250399588462/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:52.714190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.714481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.714942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.750758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] MFA Rules not processed for user `febe652409544c5d8ec6250399588462`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:52.752116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.854600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 927/1835] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:52.886094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:52.887905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:52.969130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5872-8ce0-4706-9489-80fb085c1c50 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:52.981447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:52.982112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:52.982395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:52.982815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:52.993869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:52.995533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.006365 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 909/1836] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:53.115470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:53.292398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:53.305107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7b54-c5cd-46e2-915b-8fb321d93a36 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:53.315086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:53.317390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:53.318372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:53.318829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:53.398977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:53.400502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea9049-a4ad-4a3f-a424-44020adbff53 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:53.410032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 928/1837] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:54.187073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:54.258407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.260335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:54.373916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb60a1-8919-44d7-b3af-b353b28d7d5e service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:54.377300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:54.377932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.378214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.378544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] PATH_INFO: `/v3/users/6e35757b8f8f436aaf5b536aff193686` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.379632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e35757b8f8f436aaf5b536aff193686)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:54.381667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:54.647255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e35757b8f8f436aaf5b536aff193686'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:54.655329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e35757b8f8f436aaf5b536aff193686'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:54.659235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e35757b8f8f436aaf5b536aff193686'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:54.851289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e35757b8f8f436aaf5b536aff193686'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:54.851990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e35757b8f8f436aaf5b536aff193686'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:54.872356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 910/1838] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:54 2022] DELETE /identity/v3/users/6e35757b8f8f436aaf5b536aff193686 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:54.877384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:54.877736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:54.878470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:54.897653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:54.898836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:54.960126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 929/1839] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:54.970018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:54.971437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.037640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faee9-372e-4f20-8c45-526623d2b920 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:55.041215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:55.041812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.042133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.042397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.052677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:55.054144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:55.064627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 911/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:55.534741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:55.539241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:55.579018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab24203-1072-45d0-a48f-47d42ce2c0a5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:55.596333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:55.597163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:55.597532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:55.597737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] PATH_INFO: `/v3/projects/6500dfb1269c4734b2f0bd784267dd91` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:55.599358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6500dfb1269c4734b2f0bd784267dd91)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:55.601318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:55.777685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6500dfb1269c4734b2f0bd784267dd91', 'request_id': 'req-9198b8e5-3c5e-4498-995d-3773215bdb33'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:55.794072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6500dfb1269c4734b2f0bd784267dd91', 'request_id': 'req-9198b8e5-3c5e-4498-995d-3773215bdb33'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:55.818917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6500dfb1269c4734b2f0bd784267dd91', 'request_id': 'req-9198b8e5-3c5e-4498-995d-3773215bdb33'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:55.912349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] The token cache is being invalidate because project 6500dfb1269c4734b2f0bd784267dd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:55.913139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:55.914378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:55.916706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 930/1841] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:55 2022] DELETE /identity/v3/projects/6500dfb1269c4734b2f0bd784267dd91 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:55.929779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:55.946502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914d8fb-be75-4865-968d-1cd7f336b103 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:56.061059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:56.061847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:56.062179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:56.063021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] PATH_INFO: `/v3/users/1700bc4562d64efdb7c10555c56b50bf` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:56.064440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1700bc4562d64efdb7c10555c56b50bf)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:56.066518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:56.114331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:56.296847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1700bc4562d64efdb7c10555c56b50bf'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:56.297942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1700bc4562d64efdb7c10555c56b50bf'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:56.308262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1700bc4562d64efdb7c10555c56b50bf'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:56.379102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1700bc4562d64efdb7c10555c56b50bf'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:56.380383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1700bc4562d64efdb7c10555c56b50bf'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:56.404236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 912/1842] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:55 2022] DELETE /identity/v3/users/1700bc4562d64efdb7c10555c56b50bf => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:56.828405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:57.142841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.144803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.175108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b8e5-3c5e-4498-995d-3773215bdb33 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.260976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.262439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.262793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.263134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] PATH_INFO: `/v3/projects/9487bc2383fe484da1a1a87f1700e234` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.264550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9487bc2383fe484da1a1a87f1700e234)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.269333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.412007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9487bc2383fe484da1a1a87f1700e234', 'request_id': 'req-441e0475-5eb4-4f62-9891-b2e43371bcc1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.419057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9487bc2383fe484da1a1a87f1700e234', 'request_id': 'req-441e0475-5eb4-4f62-9891-b2e43371bcc1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.442589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9487bc2383fe484da1a1a87f1700e234', 'request_id': 'req-441e0475-5eb4-4f62-9891-b2e43371bcc1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.466724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.470040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.485603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64a9b-3ff7-4919-b220-eea31503f17e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.506612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] The token cache is being invalidate because project 9487bc2383fe484da1a1a87f1700e234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:57.510026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.510673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-441e0475-5eb4-4f62-9891-b2e43371bcc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.512250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 931/1843] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:57 2022] DELETE /identity/v3/projects/9487bc2383fe484da1a1a87f1700e234 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:57.517977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d24b-f271-46f0-93c1-e72b44af5bc9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.518274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d24b-f271-46f0-93c1-e72b44af5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.518535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d24b-f271-46f0-93c1-e72b44af5bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.549242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c6a3d24b-f271-46f0-93c1-e72b44af5bc9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:57.550870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.551593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.551777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c6a3d24b-f271-46f0-93c1-e72b44af5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.552103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.552447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] PATH_INFO: `/v3/users/98ce0400557c4afaa309cd4bd34d7430` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.554026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ce0400557c4afaa309cd4bd34d7430)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.557045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.573945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 932/1844] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:57.583765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.584044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.584314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.604818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:57.606120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:57.614832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 933/1845] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:56:57.619370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.629728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c101-5ba4-4a81-8588-22096b3d6e60 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.635159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.635909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.636243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.636544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.637184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:56:57.643427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.643427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.651825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 934/1846] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:56:57.656144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.668705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b48-26f0-4411-84d7-c1a73793658e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.681207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.681848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.682130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.682401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.683030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.685954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.815298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 935/1847] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:57 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:57.819452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.879847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473bf9-b09b-430f-823f-a95c9e569eab admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.885289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.885908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.886060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.886328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.886956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:57.888913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:57.903022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ce0400557c4afaa309cd4bd34d7430'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.903740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ce0400557c4afaa309cd4bd34d7430'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.911506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ce0400557c4afaa309cd4bd34d7430'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:57.976724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 936/1848] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:57 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:57.980642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:57.991978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aca38-2e7b-493b-b70f-58f9048bf3bd admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:57.996801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:57.997464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:57.997810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:57.998141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:57.998784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.001470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.011481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 937/1849] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:58.016501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.017841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ce0400557c4afaa309cd4bd34d7430'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.018430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f052812-6584-4147-8f9e-612d4863eaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ce0400557c4afaa309cd4bd34d7430'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.027382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c37ae-b58e-4a8e-b6bb-5fb7b4b1ac70 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.033504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.034196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.034416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.034643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.035282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.036905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.043546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 913/1850] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:57 2022] DELETE /identity/v3/users/98ce0400557c4afaa309cd4bd34d7430 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:58.049074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.049665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.050309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.050435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 938/1851] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:58.058270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.060065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.075901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:58.077047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf15e0-2983-4c7c-b5d8-e4228e1c5fce admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.078392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.158439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.159130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.159398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.159670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] PATH_INFO: `/v3/projects/c61e39fbcd374f9d82149667bde6c358/users/cc3599fb8bc54766b4f13399f053ce8e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.172415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 914/1852] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:58.173528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.175088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.182889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61e39fbcd374f9d82149667bde6c358, user_id=cc3599fb8bc54766b4f13399f053ce8e, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.185647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.189012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b997-0279-4cd6-ae6e-0ff53395d512 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.194113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.194866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.195218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.195562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] PATH_INFO: `/v3/users/45f432e512e64d259f8a6bba93918888` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.197117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f432e512e64d259f8a6bba93918888)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.199159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.292231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 939/1853] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:58 2022] PUT /identity/v3/projects/c61e39fbcd374f9d82149667bde6c358/users/cc3599fb8bc54766b4f13399f053ce8e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:58.307930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.311193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.393445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048970b-0600-48f7-9f69-8a3c9c45e7ad admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.397704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.398419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.398918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.399385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.434149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f432e512e64d259f8a6bba93918888'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.435030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f432e512e64d259f8a6bba93918888'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.446577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f432e512e64d259f8a6bba93918888'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.488213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.489871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ee59e-8075-48de-8bcf-9714ddfb4291 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.502048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 940/1854] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:58.503492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.503783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.504056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.570855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f432e512e64d259f8a6bba93918888'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.571541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-983a4ab7-0df2-4b7d-b10b-9b3a5cff0850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f432e512e64d259f8a6bba93918888'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:58.587326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] MFA Rules not processed for user `cc3599fb8bc54766b4f13399f053ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:58.588588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.602455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 915/1855] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:58 2022] DELETE /identity/v3/users/45f432e512e64d259f8a6bba93918888 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:58.604184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.604700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.605197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.629059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:58.630686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.699048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 916/1856] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:58.739945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.741678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.755697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 941/1857] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:58.760263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.761340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:58.784405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441acdb-1ebf-4866-ba22-6e3236aada4d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.789965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.790613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.790894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.791289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.792299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.794765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.836090 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aae8e-923b-424a-bb92-881c1370a269 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:58.839872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:58.840307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:58.840588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:58.840893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:58.851100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:58.852679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:58.864922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 917/1858] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:56:58.904292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 942/1859] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:56:58 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:56:58.905743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:58.917212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442bcba-78b3-4e1a-8ce5-7cb232c789e3 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.000853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.000853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.000853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.000853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.001177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.002510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.091103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 918/1860] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:56:58 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:56:59.095502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.106442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dfb7-c97e-4def-aa1b-4d146500c688 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.113531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.114226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.114500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.114766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.115408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.117416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.131556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 943/1861] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:56:59.132285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.149272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4742-9215-4c07-95c4-c0ba9d98efbb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.154660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.155325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.156215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.156769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] PATH_INFO: `/v3/projects/aa5a3dcdc9b2497480f164353db90235/users/14b5975d21d341e88570c1645d85dae3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.177484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5a3dcdc9b2497480f164353db90235, user_id=14b5975d21d341e88570c1645d85dae3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.180286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.201197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.203617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.216710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed908ca-b546-4c35-93fe-c086d51a1b13 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.224769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.225635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.226059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.232027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] PATH_INFO: `/v3/projects/82e84fb59afb4021a670ec2bf7b8fef4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.232027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e84fb59afb4021a670ec2bf7b8fef4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.232027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.286979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 919/1862] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:59 2022] PUT /identity/v3/projects/aa5a3dcdc9b2497480f164353db90235/users/14b5975d21d341e88570c1645d85dae3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.290602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.369826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8554a97-1f8b-4187-8df8-55176bc302ff admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.389494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e84fb59afb4021a670ec2bf7b8fef4', 'request_id': 'req-e3e930c5-d464-4693-8210-6f01829df8c7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.397414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e84fb59afb4021a670ec2bf7b8fef4', 'request_id': 'req-e3e930c5-d464-4693-8210-6f01829df8c7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.404302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e84fb59afb4021a670ec2bf7b8fef4', 'request_id': 'req-e3e930c5-d464-4693-8210-6f01829df8c7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.440001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.440599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.440896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.441163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.441797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.443389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.452692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 920/1863] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:56:59.453577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.456105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.467888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8200bb-98dd-40c4-8235-9026b8858101 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.472484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.473094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.473372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.473641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] PATH_INFO: `/v3/users/4bb7bba8c5eb426ba530974e225a7831` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.474748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb7bba8c5eb426ba530974e225a7831)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.476622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.502784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] The token cache is being invalidate because project 82e84fb59afb4021a670ec2bf7b8fef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:59.504178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.505079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.508840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 944/1864] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:59 2022] DELETE /identity/v3/projects/82e84fb59afb4021a670ec2bf7b8fef4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:56:59.510992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.512890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.528328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e930c5-d464-4693-8210-6f01829df8c7 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.532799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.533443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.533721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.533991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] PATH_INFO: `/v3/projects/aa5a3dcdc9b2497480f164353db90235/users/14b5975d21d341e88570c1645d85dae3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.535993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5a3dcdc9b2497480f164353db90235, user_id=14b5975d21d341e88570c1645d85dae3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.538653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.550020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 945/1865] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:56:59 2022] PUT /identity/v3/projects/aa5a3dcdc9b2497480f164353db90235/users/14b5975d21d341e88570c1645d85dae3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.550636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.552145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.620096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3387-5a9a-4346-a214-4903389597bd admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.625886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.631426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.631426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.631426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] PATH_INFO: `/v3/projects/75e1eb9d1f144296acc89797f13daba0` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.631426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e1eb9d1f144296acc89797f13daba0)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.631426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.664487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb7bba8c5eb426ba530974e225a7831'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.665316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb7bba8c5eb426ba530974e225a7831'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.672865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb7bba8c5eb426ba530974e225a7831'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.787038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:59.832699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb7bba8c5eb426ba530974e225a7831'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.833874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb7bba8c5eb426ba530974e225a7831'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.855305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e1eb9d1f144296acc89797f13daba0', 'request_id': 'req-95cdb7a3-76fd-4f46-8040-7249657200b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.855676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 921/1866] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:59 2022] DELETE /identity/v3/users/4bb7bba8c5eb426ba530974e225a7831 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.856551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:59.857968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:59.866470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e1eb9d1f144296acc89797f13daba0', 'request_id': 'req-95cdb7a3-76fd-4f46-8040-7249657200b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.875338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e1eb9d1f144296acc89797f13daba0', 'request_id': 'req-95cdb7a3-76fd-4f46-8040-7249657200b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.935769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141ec-cef4-446a-93d4-ff492ef0f259 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:59.941557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:59.942223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.942506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.942775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] PATH_INFO: `/v3/users/9c44248855e94499adf7a356c0a5ebfb` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:59.943918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c44248855e94499adf7a356c0a5ebfb)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:59.945874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:59.975834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] The token cache is being invalidate because project 75e1eb9d1f144296acc89797f13daba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:59.976372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.976786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-95cdb7a3-76fd-4f46-8040-7249657200b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:59.978332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 946/1867] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:59 2022] DELETE /identity/v3/projects/75e1eb9d1f144296acc89797f13daba0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:59.979545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b58ca-b621-4c80-aba4-886a3300adf4 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:59.979828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b58ca-b621-4c80-aba4-886a3300adf4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:59.980100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b58ca-b621-4c80-aba4-886a3300adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.009036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-966b58ca-b621-4c80-aba4-886a3300adf4 None None] MFA Rules not processed for user `14b5975d21d341e88570c1645d85dae3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:00.011977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-966b58ca-b621-4c80-aba4-886a3300adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.078474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 947/1868] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:00.079714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.079996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.080265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.098995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:00.100197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.107780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 948/1869] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:00.108558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.110366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.122014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8feed-f67a-4c49-816d-0de7f2e92f12 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.125210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c44248855e94499adf7a356c0a5ebfb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.125955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c44248855e94499adf7a356c0a5ebfb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.126930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.127554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.127858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.128147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] PATH_INFO: `/v3/users/8c608bf5b2b4415e8d9f9b8cedcb40c6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.129277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c608bf5b2b4415e8d9f9b8cedcb40c6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.131181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.133077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c44248855e94499adf7a356c0a5ebfb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.203776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c44248855e94499adf7a356c0a5ebfb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.204420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c44248855e94499adf7a356c0a5ebfb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.223195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 922/1870] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:59 2022] DELETE /identity/v3/users/9c44248855e94499adf7a356c0a5ebfb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:00.227017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.228357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.285604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:00.292644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b9a9-6610-4034-ac52-4114bdb9f691 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.296653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.297295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.297577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.297851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.299823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.323349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c608bf5b2b4415e8d9f9b8cedcb40c6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.337540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c608bf5b2b4415e8d9f9b8cedcb40c6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.344979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c608bf5b2b4415e8d9f9b8cedcb40c6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.345902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c608bf5b2b4415e8d9f9b8cedcb40c6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.346535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c608bf5b2b4415e8d9f9b8cedcb40c6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.375861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.377341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.387285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 923/1871] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:00.388135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.391698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.411544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 949/1872] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:00 2022] DELETE /identity/v3/users/8c608bf5b2b4415e8d9f9b8cedcb40c6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:00.465547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41520f-5581-4988-a71d-23e8b58ab52e service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.499220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.502139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.566051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.567041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.567511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.567787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.576048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.621329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db45c8-98b1-44d6-9d35-543be42d8453 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.628264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.629279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.629982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.630409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] PATH_INFO: `/v3/users/cc3599fb8bc54766b4f13399f053ce8e` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.631974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3599fb8bc54766b4f13399f053ce8e)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.636840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.659002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.661371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.697268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 924/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:00.800115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:00.801787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:00.823059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60e9da-5160-452a-8f4d-936c1081f318 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:00.831018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:00.831771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:00.831966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:00.832264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] PATH_INFO: `/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:00.833987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36cde3ad2264b73ae8e34627c9e0b1e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:00.835619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:00.867953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3599fb8bc54766b4f13399f053ce8e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.883050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3599fb8bc54766b4f13399f053ce8e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.890328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3599fb8bc54766b4f13399f053ce8e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.891826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3599fb8bc54766b4f13399f053ce8e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.892972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1a5eabd3-8dbc-4d46-aaf9-1eb69702b832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3599fb8bc54766b4f13399f053ce8e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:00.997903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36cde3ad2264b73ae8e34627c9e0b1e', 'request_id': 'req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.014528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36cde3ad2264b73ae8e34627c9e0b1e', 'request_id': 'req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.034331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36cde3ad2264b73ae8e34627c9e0b1e', 'request_id': 'req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.034856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 950/1874] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:00 2022] DELETE /identity/v3/users/cc3599fb8bc54766b4f13399f053ce8e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.045265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.045464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.045706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.069472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.071143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.133803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 951/1875] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:01.146059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.148918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] The token cache is being invalidate because project b36cde3ad2264b73ae8e34627c9e0b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:01.149216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.151846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.153637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.154150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 925/1876] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:00 2022] DELETE /identity/v3/projects/b36cde3ad2264b73ae8e34627c9e0b1e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.155464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.156962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.241677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5d896-b0a0-4cbd-93f8-b6203ee5e1e9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.246047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.247126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.247407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.247679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.249667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.265780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.268671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b8ad8-8589-4e2f-a6d9-ba34bbca6cf2 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.278025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a07d70-86d7-4a3d-808b-a6a3aa9906d0 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.280898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 952/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:01.282785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc695e-8591-464a-8f94-f05a4bf094fa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.283162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc695e-8591-464a-8f94-f05a4bf094fa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.283443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc695e-8591-464a-8f94-f05a4bf094fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.285110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.286060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.286590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.287010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] PATH_INFO: `/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.288703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a41ad9b8074882aafb5f960a7d1b89)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.291619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.307576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ebcc695e-8591-464a-8f94-f05a4bf094fa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.309085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ebcc695e-8591-464a-8f94-f05a4bf094fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.320231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 953/1878] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:01.328337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.329003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.329437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.351796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.352969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.364846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 954/1879] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:01.368275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.385486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db1cb9-330d-4aa4-8639-3835142467cf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.397009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a41ad9b8074882aafb5f960a7d1b89', 'request_id': 'req-55f5c747-8361-4796-a217-08de2df4e16f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.403963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a41ad9b8074882aafb5f960a7d1b89', 'request_id': 'req-55f5c747-8361-4796-a217-08de2df4e16f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.411012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a41ad9b8074882aafb5f960a7d1b89', 'request_id': 'req-55f5c747-8361-4796-a217-08de2df4e16f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.453033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.454376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.454712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.454979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.455615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:01.455967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.457576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.470384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 955/1880] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:01.475701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.479226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] The token cache is being invalidate because project c7a41ad9b8074882aafb5f960a7d1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:01.479667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.480371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.485892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 926/1881] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:01 2022] DELETE /identity/v3/projects/c7a41ad9b8074882aafb5f960a7d1b89 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.486812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.487318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415756c-e1a3-4113-b354-5f923d220fa0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.488275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.492413 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.493080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.493411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.493684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.494315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.496300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd495b-d813-4ed4-8fee-082b1bada561 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.504160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c747-8361-4796-a217-08de2df4e16f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.516794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] PATH_INFO: `/v3/projects/3a4f08cb54cf4f98b903e350971fe5ed` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.517150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4f08cb54cf4f98b903e350971fe5ed)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.517150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.605417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 956/1882] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:01.609850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.610350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.610805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.632955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:01.635300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.650474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4f08cb54cf4f98b903e350971fe5ed', 'request_id': 'req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.658283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4f08cb54cf4f98b903e350971fe5ed', 'request_id': 'req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.665494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4f08cb54cf4f98b903e350971fe5ed', 'request_id': 'req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.756003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:01.761036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] The token cache is being invalidate because project 3a4f08cb54cf4f98b903e350971fe5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:01.761331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.762643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:01.764813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 927/1883] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:01 2022] DELETE /identity/v3/projects/3a4f08cb54cf4f98b903e350971fe5ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:01.768651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.771669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.787163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 957/1884] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:01.788278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:01.789449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:01.809328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb21e-63d5-4272-92d9-0f3f4e2ccae8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.817024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.817772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.818937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.818937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] PATH_INFO: `/v3/users/febe652409544c5d8ec6250399588462` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.819649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] RBAC: Authorizing `identity:delete_user(user_id=febe652409544c5d8ec6250399588462)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.821897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:01.960303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19d8a-381f-422a-9a3b-f0bd1ecbb3a5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:01.960303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:01.960303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:01.960303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:01.961209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:01.961209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:01.961209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f98e2-7b3a-4782-b7de-5b461f8afdb0 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.073910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 928/1885] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:01 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:02.077737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.078039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.078310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.105903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:02.107791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.117469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 929/1886] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:02.118262 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.128628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297829-adc8-4f4e-8e46-cc751ae82996 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.133996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.138795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.138795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.138795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.138795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.138795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.157443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 930/1887] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:02.157443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.164586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f120d32-e68e-49f9-8895-14e9e9f72428 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.169825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.173274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.173274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.173274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.173274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:02.173274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.174225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.188221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 931/1888] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:02.188891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.200399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d16de-9045-4e86-8e4f-18741f8ead7b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.205513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.206117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.206398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.206670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.207319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.208948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.226004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 932/1889] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:02.232586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.240367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febe652409544c5d8ec6250399588462'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.244287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7cd09-f0de-4452-a4e7-407cc6834ac4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.258405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.258519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febe652409544c5d8ec6250399588462'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.258601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.262074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.262383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.263122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.265830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febe652409544c5d8ec6250399588462'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.266681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.266961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febe652409544c5d8ec6250399588462'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.267466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febe652409544c5d8ec6250399588462'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.375363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 958/1890] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:01 2022] DELETE /identity/v3/users/febe652409544c5d8ec6250399588462 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:02.376302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.377896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.422958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 933/1891] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:02 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:02.424143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.429190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.470038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a09cef-69ab-494e-b069-e4399f93243b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.511031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b215-474d-4861-85a7-891e2e545760 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.516879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.517750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.517889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.518062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] PATH_INFO: `/v3/projects/f92e6250d7a34fbeb9b189fd042c4d0a/users/abd59de443094d49a6c282e7e3a9f753/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.535097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92e6250d7a34fbeb9b189fd042c4d0a, user_id=abd59de443094d49a6c282e7e3a9f753, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.537043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:02.538049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.543633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.548310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.548310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.548310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] PATH_INFO: `/v3/projects/c61e39fbcd374f9d82149667bde6c358` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.548310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61e39fbcd374f9d82149667bde6c358)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.548646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.669127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 934/1892] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:02 2022] PUT /identity/v3/projects/f92e6250d7a34fbeb9b189fd042c4d0a/users/abd59de443094d49a6c282e7e3a9f753/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:02.670624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.673032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.699953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61e39fbcd374f9d82149667bde6c358', 'request_id': 'req-a2a82672-d96f-412c-9ad2-cddd0292c1b0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.711236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61e39fbcd374f9d82149667bde6c358', 'request_id': 'req-a2a82672-d96f-412c-9ad2-cddd0292c1b0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.721899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61e39fbcd374f9d82149667bde6c358', 'request_id': 'req-a2a82672-d96f-412c-9ad2-cddd0292c1b0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.759214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c15b-1138-41f9-ae93-1ac5fb5debf5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.810273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] The token cache is being invalidate because project c61e39fbcd374f9d82149667bde6c358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:02.812281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.814945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a2a82672-d96f-412c-9ad2-cddd0292c1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:02.819253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 959/1893] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:02 2022] DELETE /identity/v3/projects/c61e39fbcd374f9d82149667bde6c358 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:02.820058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.820441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.820816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.850574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.851363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.851642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.851748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] MFA Rules not processed for user `abd59de443094d49a6c282e7e3a9f753`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:02.852496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.852617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.853194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.854592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.932435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 960/1894] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:02.933372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.934757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.949572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b480-fc17-446d-8626-b1f163da1cd9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.959270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:02.960865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:02.960865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:02.960865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] PATH_INFO: `/v3/users/14b5975d21d341e88570c1645d85dae3` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:02.961897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b5975d21d341e88570c1645d85dae3)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:02.964610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:02.967635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 935/1895] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:02 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:02.972049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:02.977372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:02.993302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad02a4-fc94-41bf-bab1-10bc43bcb2ec admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:02.999259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.000157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.001133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.001542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] PATH_INFO: `/v3/projects/ccae50d6e1594e10b07aebad30e47a0d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.002808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccae50d6e1594e10b07aebad30e47a0d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.004877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.152337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:03.173617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccae50d6e1594e10b07aebad30e47a0d', 'request_id': 'req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.182651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccae50d6e1594e10b07aebad30e47a0d', 'request_id': 'req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.189055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b5975d21d341e88570c1645d85dae3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.189394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccae50d6e1594e10b07aebad30e47a0d', 'request_id': 'req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.204245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b5975d21d341e88570c1645d85dae3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.212263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b5975d21d341e88570c1645d85dae3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.213029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b5975d21d341e88570c1645d85dae3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.213639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b5975d21d341e88570c1645d85dae3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.267105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] The token cache is being invalidate because project ccae50d6e1594e10b07aebad30e47a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:03.267551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.268259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:03.269931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 936/1896] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:02 2022] DELETE /identity/v3/projects/ccae50d6e1594e10b07aebad30e47a0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:03.270762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.272139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.322799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 961/1897] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:02 2022] DELETE /identity/v3/users/14b5975d21d341e88570c1645d85dae3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:03.323865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.325365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.361755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767621e5-26d9-4fce-aaa4-4f89c1e3cd21 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.406564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7ed4-b63a-4769-b8c4-b6dd77c17a5c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.415543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.416731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.417751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.417751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.418105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.421054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adcbdb-976b-4c41-82d1-42d92adbbe73 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.443213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 962/1898] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:03.445112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.446528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.446528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.463942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.465554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.465982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.466383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.467245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.468750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:03.470502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.477655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.486869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 963/1899] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:03.487729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.489150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.502384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e66d01-34bb-45f1-a7e7-a59d8dba23a7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.507995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.511861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.511861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.511861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.511861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.511861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97a9f6-55f7-44d2-b70d-d2fed8fcac86 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.524144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 964/1900] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:03.525500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.526043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.526310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.533423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:03.549969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:03.551272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.569426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 965/1901] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:03.569426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.570659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 937/1902] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:03.572892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.602301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91005c58-9443-4bd8-a51c-d4d91b3677b9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.701120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790a54-574d-43b4-b6d1-a09a099a032a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.702812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.704356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.704817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.705005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] PATH_INFO: `/v3/projects/fe96e6cd18184ea98bf44d19af498543/users/f819412e39c64660bd5a8011adbb19f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.707517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.708131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.708411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.708750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.709617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:03.710370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.711687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.728271 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe96e6cd18184ea98bf44d19af498543, user_id=f819412e39c64660bd5a8011adbb19f1, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.729722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 938/1903] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:03.730807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.730921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.755816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e973896-eee6-4999-a172-b3a1014d69ee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.770226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.771652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.772101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.772522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.773383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.776010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df605f-7067-4d21-ad46-c4c309020f28 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:03.830258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 966/1904] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:03 2022] PUT /identity/v3/projects/fe96e6cd18184ea98bf44d19af498543/users/f819412e39c64660bd5a8011adbb19f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:03.830979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:03.890229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 939/1905] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:03.892450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.893152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.893152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.959757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] MFA Rules not processed for user `f819412e39c64660bd5a8011adbb19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:03.963462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:03.973156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891d78-35cb-414c-a58a-e2b7cc5a9cab admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:03.985305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:03.985305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:03.985305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:03.985305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:03.985750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:03.987466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.067790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 940/1906] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:04.068957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.096352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 967/1907] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:03 2022] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:04.096352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.111784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98847c-63a9-4ba2-8331-b328b98bcf33 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.204525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.205479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.205924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.206348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.207195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.210216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.219883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df15e-01fc-48a5-b501-7e9831b9499d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.224270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 941/1908] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:04.225260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.228182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.237588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.238188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.238470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.238907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.239549 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.246326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f81f-dbec-456c-86dd-7eaaed0a5e36 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.246436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.253208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.254056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.254555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.255001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] PATH_INFO: `/v3/projects/aa5a3dcdc9b2497480f164353db90235` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.256536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5a3dcdc9b2497480f164353db90235)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.258704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.398551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 968/1909] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:04.398551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.463464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5a3dcdc9b2497480f164353db90235', 'request_id': 'req-4c22f633-c3cf-4d46-8678-2d570d71a20c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.476639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5a3dcdc9b2497480f164353db90235', 'request_id': 'req-4c22f633-c3cf-4d46-8678-2d570d71a20c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.488958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd31391-c693-4678-b19a-ad2c02e0ae2d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.497416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5a3dcdc9b2497480f164353db90235', 'request_id': 'req-4c22f633-c3cf-4d46-8678-2d570d71a20c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.592400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.593135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.593506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.593851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.595240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.597805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.603349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] The token cache is being invalidate because project aa5a3dcdc9b2497480f164353db90235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:04.603640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.604316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:04.609331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 942/1910] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:04 2022] DELETE /identity/v3/projects/aa5a3dcdc9b2497480f164353db90235 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:04.609331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.611523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.617294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:04.625449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f633-c3cf-4d46-8678-2d570d71a20c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.631321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.632122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.632401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.633274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] PATH_INFO: `/v3/projects/9560dbb7cd63463a8c39102ee65caad2/users/851038b2f39448f586a39df2c53646c0/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.650960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9560dbb7cd63463a8c39102ee65caad2, user_id=851038b2f39448f586a39df2c53646c0, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.655335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3d1b-2562-42e0-9e76-19e269b5d621 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.707734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:04.744941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 969/1911] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:04.746960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.751240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 943/1912] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:04 2022] PUT /identity/v3/projects/9560dbb7cd63463a8c39102ee65caad2/users/851038b2f39448f586a39df2c53646c0/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:04.753398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.753679 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.755578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.759707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.777846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592fbe-3138-44ef-9007-5b9b19425029 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.786561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:04.787750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.855793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.860372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.860372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.860372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.860372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.860372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.876076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 944/1913] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:04.881707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.883306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.897468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5445ea8-b25b-48ea-b931-cf4a2279f24a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.903874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.904900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.905282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.905656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.906377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.908773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.919123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 945/1914] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:04.919999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.930014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d0c-4e28-46c7-9f06-57850c37284c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.934795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:04.935377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.935657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.935928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.936570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:04.938309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868ca2-dfd7-4d22-aca0-083908bef7f0 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:04.949833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 946/1915] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:04.955011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:04.955011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:04.955011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:04.971252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:04.972461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:04.982272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 947/1916] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:04.983919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.987160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 970/1917] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:04 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:04.987757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:04.999273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331d09-9fa4-4432-990c-ecdc30132899 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:04.999982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95f57-dfb8-4e1d-a8bb-700989ced251 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.004331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.005102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.005260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.005514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.005872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] PATH_INFO: `/v3/projects/9560dbb7cd63463a8c39102ee65caad2/users/851038b2f39448f586a39df2c53646c0/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.006452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.006870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.007298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.008059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9560dbb7cd63463a8c39102ee65caad2, user_id=851038b2f39448f586a39df2c53646c0, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.008348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.010124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.011025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.023108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 948/1918] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:05.027126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 971/1919] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:04 2022] PUT /identity/v3/projects/9560dbb7cd63463a8c39102ee65caad2/users/851038b2f39448f586a39df2c53646c0/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:05.027227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.027303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.044710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c05f3-20fb-46aa-be7a-e51e783f5148 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.099609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838019a-515b-4649-a0ed-a2ed3aca986e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.105366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.106038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.106319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.106590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.107232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.108863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.114902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.116355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.116762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.117039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.117701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:05.118010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.119624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d305-af59-4895-83a8-0937615a1a7d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.123780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 972/1920] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:05.123780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.135166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 949/1921] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:05.138824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dff40-a456-4ed1-9c7b-d1e2952d030a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.138911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.138911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.138911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.143772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.144510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.144888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.145299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] PATH_INFO: `/v3/projects/677b39a63ff1480cb120db29a4a4b652/users/b6d02f72a6dc4705b1079e19326ddf5e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.161906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677b39a63ff1480cb120db29a4a4b652, user_id=b6d02f72a6dc4705b1079e19326ddf5e, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.164749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.169748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] MFA Rules not processed for user `851038b2f39448f586a39df2c53646c0`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:05.170953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.248128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 950/1922] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:05.249026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.260347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 973/1923] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:05 2022] PUT /identity/v3/projects/677b39a63ff1480cb120db29a4a4b652/users/b6d02f72a6dc4705b1079e19326ddf5e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:05.260347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.272687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc05a-c01d-4fc9-89a9-aa81a868ca25 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.330464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.331086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.331369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.331643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.332295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.334009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.334403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92cba8-b667-434c-b856-4003939d5117 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.339040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.339657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.339972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.340241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.340887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.342875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ab998-4956-4e5d-8782-3af266e09ac1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.346191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 951/1924] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:05.346191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.347157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.405606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957b2fe-e490-41ed-a69b-6bf5781e19ed admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.409554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.410155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.410437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.410708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.431090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 974/1925] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:05.432304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.432646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.433008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.463084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] MFA Rules not processed for user `b6d02f72a6dc4705b1079e19326ddf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:05.464308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.480541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.482710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.494494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 952/1926] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:05.495088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.508280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963bfd9-22fb-4a91-a022-4ad9a133120c service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.546434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 975/1927] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:05.548697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.577735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.579132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.579609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.580207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] PATH_INFO: `/v3/projects/6e9f29da366d403a9db83a9838d4e8b8/users/01c3dc4ea90543368c9b38c7819743f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.597100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9f29da366d403a9db83a9838d4e8b8, user_id=01c3dc4ea90543368c9b38c7819743f1, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.599760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.626905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c1b2-f6d6-41b7-9fef-cda452d0c99c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.631857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.632123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.632395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.632682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.633306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.635698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b9478-9a46-46c7-aabe-c443155d8f03 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.644893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:05.679423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 953/1928] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:05 2022] PUT /identity/v3/projects/6e9f29da366d403a9db83a9838d4e8b8/users/01c3dc4ea90543368c9b38c7819743f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:05.680431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.682435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.739719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 976/1929] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:05.746049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.746049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.746049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.789460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] MFA Rules not processed for user `01c3dc4ea90543368c9b38c7819743f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:05.790806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:05.812126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff354b3-afbf-4fed-86be-2c892417ad2f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.818109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.818852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.822514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.822514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.890873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 977/1930] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:05.890873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.910753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.912413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:05.924571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 954/1931] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:05.925366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:05.975166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593b17-3f90-41dc-bc4b-f2a3ba469112 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:05.981415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:05.983051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:05.983537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:05.985162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:05.986159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:05.988435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.005947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 978/1932] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:06.007209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.035628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0bf7-7b83-4e12-96ed-965ac84c7458 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.050263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de798c-45a1-4809-a346-cc76d265c547 service glance] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.051850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.053524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.054404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.055845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.056476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.056791 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.057064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.057774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.059740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.060158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:06.061135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.062486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.088066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.121070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 979/1933] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:06.123829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.138433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117a53d-536d-407f-8f8d-4dee917daa86 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.145453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.149354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.149762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.150138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] PATH_INFO: `/v3/projects/5e91bff302474b56865d3d49455de525/users/b6b8e23e30fe4248bc7b55b8c86836a7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.177229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e91bff302474b56865d3d49455de525, user_id=b6b8e23e30fe4248bc7b55b8c86836a7, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.180768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898feeb6-ce23-4c22-b130-5502a4435a76 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.206200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 955/1934] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:05 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:06.207072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.281309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 980/1935] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:06 2022] PUT /identity/v3/projects/5e91bff302474b56865d3d49455de525/users/b6b8e23e30fe4248bc7b55b8c86836a7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:06.292552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.292866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.293140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.323184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1c55-1388-4b56-b9b8-55ba2d744931 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.356170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] MFA Rules not processed for user `b6b8e23e30fe4248bc7b55b8c86836a7`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:06.362368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:06.445970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.446906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.447309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.449812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.451196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.454495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.498929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 981/1936] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:06.504312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.516948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd8c5-a8af-44cb-93be-83de8ffd3ec5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.522794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.523647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.524031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.524513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.525199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.527491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.622115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 956/1937] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:06 2022] POST /identity/v3/users => generated 294 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:06.624536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.649567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e602-6afa-4fd8-8d87-965bb2f3dc47 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.663809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.664759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.665138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 982/1938] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:06 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:06.665582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.665857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.666665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.668250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.670914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.693379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 957/1939] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:06.697214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.711917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78c3a-50ec-415d-8306-39a2c25a78e6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.759450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d4e9-f4c6-449a-90b6-16ee5f619eff admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.767267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.768015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.768434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.769221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.769589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.776234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.851842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.852691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.853167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.853548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] PATH_INFO: `/v3/projects/bf57b55b3f3a412b898d3d8eb772e123/users/784a8c9ae7764a6eb1990b736f99e022/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.871115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf57b55b3f3a412b898d3d8eb772e123, user_id=784a8c9ae7764a6eb1990b736f99e022, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.874137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.962306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 983/1940] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:06 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:06.970733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.988801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8d74-5ab8-4c8c-94d0-12fe81dcce73 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.998245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.007109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 958/1941] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:06 2022] PUT /identity/v3/projects/bf57b55b3f3a412b898d3d8eb772e123/users/784a8c9ae7764a6eb1990b736f99e022/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:07.007277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.007277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.007277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.007277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.007277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.010094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.027561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 984/1942] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:07.032074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.043006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4f4e2-9afe-4ca5-a9d9-6492ece21bd2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.122760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14974fb4-f01f-477f-b7fa-dbaf93409554 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.148113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.150015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.151056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.152155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.153359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.155571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.161687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.168798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.168798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.168798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] PATH_INFO: `/v3/projects/77ebf001669641db85a9bba719ec4011/users/4efe9422e2fa4d7f8809cd2a17604b08/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.182342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 959/1943] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:07.186561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.211063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee03d4-4c71-42ca-8823-b9277c73bd2c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.233908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.235299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.235709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.238027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] PATH_INFO: `/v3/projects/bf57b55b3f3a412b898d3d8eb772e123/users/784a8c9ae7764a6eb1990b736f99e022/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.238474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ebf001669641db85a9bba719ec4011, user_id=4efe9422e2fa4d7f8809cd2a17604b08, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.242253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.246642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf57b55b3f3a412b898d3d8eb772e123, user_id=784a8c9ae7764a6eb1990b736f99e022, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.252350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b093-e851-425f-9e50-c79b78a646cf admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.264856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 960/1944] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:07 2022] PUT /identity/v3/projects/bf57b55b3f3a412b898d3d8eb772e123/users/784a8c9ae7764a6eb1990b736f99e022/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:07.278368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.278650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.278930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.321356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] MFA Rules not processed for user `784a8c9ae7764a6eb1990b736f99e022`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:07.324068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:07.331569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:07.345411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 985/1945] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:07 2022] PUT /identity/v3/projects/77ebf001669641db85a9bba719ec4011/users/4efe9422e2fa4d7f8809cd2a17604b08/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:07.346800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.402865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:07.449575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a422-c5a4-473f-91bb-d7aa520df9a6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.453416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 961/1946] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:07.459078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.463316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.463316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.463316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.463316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.465744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.467508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.479060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 986/1947] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:07.491183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.498084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efd720-35f3-4904-9d73-b9e166aef909 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.506159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.507673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.508571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.509017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] PATH_INFO: `/v3/projects/77ebf001669641db85a9bba719ec4011/users/4efe9422e2fa4d7f8809cd2a17604b08/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.512914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ebf001669641db85a9bba719ec4011, user_id=4efe9422e2fa4d7f8809cd2a17604b08, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.519121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a826d-b983-4c77-aab7-272622f9d8d6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.543439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 987/1948] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:07 2022] PUT /identity/v3/projects/77ebf001669641db85a9bba719ec4011/users/4efe9422e2fa4d7f8809cd2a17604b08/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:07.545349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.545642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.546012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.547131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd089-1b1c-4c02-9025-3a718fbce78f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.582133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] MFA Rules not processed for user `4efe9422e2fa4d7f8809cd2a17604b08`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:07.583449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:07.627466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.642706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.643116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.643425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.652759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:07.723928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 988/1949] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:07.784944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.788378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.797733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 962/1950] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:07.829063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:07.830494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:07.848847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d506dc6-18fd-47f4-b5d5-1c67abe9b864 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:07.854243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:07.854989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:07.855280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:07.855604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:07.872917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:07.874680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:07.887353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 989/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:08.257012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:08.268906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d13c5-f416-4060-90f0-d0f85bbf0df3 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:08.273418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:08.274149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:08.274432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:08.274762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:08.340207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:08.341709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:08.351463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 963/1952] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:09.679184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:09.834833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:10.400151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:10.439742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:10.449136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9faf9-7b0b-4130-aada-f6572a4a573a service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:10.455174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:10.460609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:10.460609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:10.460609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:10.497739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1e979-55e0-436d-8e65-7af2638efc27 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:10.502590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:10.503208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:10.503480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:10.503751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] PATH_INFO: `/v3/users/abd59de443094d49a6c282e7e3a9f753` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:10.505032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd59de443094d49a6c282e7e3a9f753)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:10.506995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:10.522388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:10.523933 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035136f5-79c6-42c2-8a92-ebd9c8e93835 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:10.533730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 964/1953] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:10.795504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd59de443094d49a6c282e7e3a9f753'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:10.811959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd59de443094d49a6c282e7e3a9f753'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:10.819128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd59de443094d49a6c282e7e3a9f753'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:10.820007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd59de443094d49a6c282e7e3a9f753'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:10.820612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd59de443094d49a6c282e7e3a9f753'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:10.901971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 990/1954] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:10 2022] DELETE /identity/v3/users/abd59de443094d49a6c282e7e3a9f753 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:10.908158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:10.908930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:10.909395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:10.934568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:10.935832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:11.003121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 965/1955] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:11.014616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:11.017126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:11.085476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99855b-31aa-430d-b47c-cde9872e4115 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:11.097952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:11.099031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:11.099312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:11.099597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:11.109404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:11.111015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:11.121000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 991/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:11.713339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:11.714749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:11.727239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464252-dcb0-4ea1-adda-d3fc1f3bffdb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:11.732421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:11.733579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:11.733579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:11.733579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] PATH_INFO: `/v3/projects/f92e6250d7a34fbeb9b189fd042c4d0a` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:11.734835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92e6250d7a34fbeb9b189fd042c4d0a)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:11.736784 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:11.896102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92e6250d7a34fbeb9b189fd042c4d0a', 'request_id': 'req-147e67de-9b71-480a-9bd6-acf1831d9c6e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:11.902915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92e6250d7a34fbeb9b189fd042c4d0a', 'request_id': 'req-147e67de-9b71-480a-9bd6-acf1831d9c6e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:11.908512 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92e6250d7a34fbeb9b189fd042c4d0a', 'request_id': 'req-147e67de-9b71-480a-9bd6-acf1831d9c6e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.023071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] The token cache is being invalidate because project f92e6250d7a34fbeb9b189fd042c4d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:12.023278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.027229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.027229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 966/1957] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:11 2022] DELETE /identity/v3/projects/f92e6250d7a34fbeb9b189fd042c4d0a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:12.031273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:12.041710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84095a-87b5-42af-bfc6-334a1c7afea4 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:12.102114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:12.103412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:12.103412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:12.103412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] PATH_INFO: `/v3/users/851038b2f39448f586a39df2c53646c0` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:12.104469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=851038b2f39448f586a39df2c53646c0)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:12.107323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:12.283584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:12.333397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851038b2f39448f586a39df2c53646c0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.342681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:12.358179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851038b2f39448f586a39df2c53646c0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.363060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:12.365039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:12.373250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851038b2f39448f586a39df2c53646c0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.374321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851038b2f39448f586a39df2c53646c0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.375641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851038b2f39448f586a39df2c53646c0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:12.435930 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e67de-9b71-480a-9bd6-acf1831d9c6e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:12.440118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:12.440855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:12.441203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:12.441541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:12.443459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:12.462448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 992/1958] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:12 2022] DELETE /identity/v3/users/851038b2f39448f586a39df2c53646c0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:12.552843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:12.554420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f4a03-d1ee-48bb-bbab-3e49d5c7c78a service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:12.575273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 967/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:12.994414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:12.996959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.114055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd8a97-48f2-4511-8f5a-a3b1d2d15b5f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.121287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.122065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.122445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.122722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] PATH_INFO: `/v3/projects/9560dbb7cd63463a8c39102ee65caad2` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.125507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9560dbb7cd63463a8c39102ee65caad2)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.129624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.268604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9560dbb7cd63463a8c39102ee65caad2', 'request_id': 'req-195fa5c4-4639-4bac-b0c2-2e8edca90441'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.275290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9560dbb7cd63463a8c39102ee65caad2', 'request_id': 'req-195fa5c4-4639-4bac-b0c2-2e8edca90441'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.282312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9560dbb7cd63463a8c39102ee65caad2', 'request_id': 'req-195fa5c4-4639-4bac-b0c2-2e8edca90441'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.391775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] The token cache is being invalidate because project 9560dbb7cd63463a8c39102ee65caad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:13.392375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.393107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-195fa5c4-4639-4bac-b0c2-2e8edca90441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:13.394788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 993/1960] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:12 2022] DELETE /identity/v3/projects/9560dbb7cd63463a8c39102ee65caad2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:13.400866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.401792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.402220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.454637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:13.456403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.534885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 968/1961] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:13.543156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.543452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.543718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.572805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:13.574120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:13.598447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 994/1962] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:13.608643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.623507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b75bc-918a-41fd-a14a-43b7294f7f54 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.646027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.647013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.647477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.647820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.648901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:13.649450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.651573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.664285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 969/1963] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:13.669042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.678795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cee5-d7c0-4065-a4f9-4a6ddd00c9d0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.683783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.684389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.684681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.684964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.685674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.688706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:13.825054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 995/1964] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:13 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:13.826234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:13.837312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc494a4c-858b-4a95-bfab-836e415b9a7b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:13.907741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:13.908544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:13.909010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:13.909442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:13.910789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:13.914044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.029070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 970/1965] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:13 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:14.033755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.044535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc68d3-c7cb-44b7-bb6c-96fe700a8377 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.054628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:14.056043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.057319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.060872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.060872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.060872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.060872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.072538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 996/1966] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:14.077000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.091743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1d444-ce5f-48c6-8cba-bf576e0086bb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.097911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.098806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.099267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.099651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.100322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.102078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7d3b-485a-4d5e-b707-551e0ffc9302 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.110492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:14.118412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 971/1967] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:14.121832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.136243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20680dd-2353-4fd7-83ed-c0b2c9eca122 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.142045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.142727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.143129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.143404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] PATH_INFO: `/v3/projects/6f94f96c488f4e48900cda6b2d61c80f/users/2a621f419a0741b5b166af0cb87ff3a7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.166463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f94f96c488f4e48900cda6b2d61c80f, user_id=2a621f419a0741b5b166af0cb87ff3a7, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.166463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.290442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 997/1968] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:14 2022] PUT /identity/v3/projects/6f94f96c488f4e48900cda6b2d61c80f/users/2a621f419a0741b5b166af0cb87ff3a7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:14.307405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.307405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.307405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.352251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] MFA Rules not processed for user `2a621f419a0741b5b166af0cb87ff3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:14.355170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:14.445588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 972/1969] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:14.456162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.541932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d57e9-a87d-4e7a-86ca-1fdbab74bd8b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.546595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.551379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.551379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.551379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.551379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.551379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.682119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 998/1970] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:14 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:14.687358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.705468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a77d4-1942-4762-8534-df0fc410c4b8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.782012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.783051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.783581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.784017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.784874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.787974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.898670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 973/1971] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:14 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:14.902680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.921074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae156-26f2-4ef4-942b-b1ed5ac6b7e9 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.928090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.928264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.929031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.929313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.930020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.932696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.944352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 999/1972] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:14.948775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.963567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f4d-0244-45e0-b5aa-7e00df990672 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:14.969268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:14.970003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:14.970269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:14.970491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:14.971221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:14.972934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b8886-aca4-4233-a4d7-1924c8f22144 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:14.984740 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 974/1973] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:14.988699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:14.999158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5510ff-31b9-42fc-b22b-dad73e80a731 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.004952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.005738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.006019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.006287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] PATH_INFO: `/v3/projects/879805c00ada4674a892c3583643a59e/users/d066fb287c8d4e018ecd57a2fd9c156d/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.024063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879805c00ada4674a892c3583643a59e, user_id=d066fb287c8d4e018ecd57a2fd9c156d, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.027090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.119263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1000/1974] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:14 2022] PUT /identity/v3/projects/879805c00ada4674a892c3583643a59e/users/d066fb287c8d4e018ecd57a2fd9c156d/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:15.130034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.130321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.130599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.164052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] MFA Rules not processed for user `d066fb287c8d4e018ecd57a2fd9c156d`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:15.165583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:15.267707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 975/1975] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:15.268925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.370638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf9f45-9e3a-42f1-89fc-6a0be1d4d5d6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.376331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.377206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.377489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.377752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.378392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.380436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.522964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1001/1976] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:15 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:15.527306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.552284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a2921-cd09-4169-a7fa-ab950b68f82c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.611917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.612649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.612961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.613235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.613893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.615836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.718206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.721333 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:15.739892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bccf-b819-46f6-a344-3a24571eda75 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.739999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 976/1977] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:15 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:15.742511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.749209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.749928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.750420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.750852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] PATH_INFO: `/v3/users/b6b8e23e30fe4248bc7b55b8c86836a7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.752580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64301009-73bb-41aa-bc81-5c85f0069c79 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.753266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b8e23e30fe4248bc7b55b8c86836a7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.756133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.757970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.758788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.759063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.759334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.759984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.761690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.773335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 977/1978] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:15.777758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.787999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eb9d6-ded3-4736-90af-b35e8432f512 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:15.792618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:15.793279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:15.793559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:15.793834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] PATH_INFO: `/v3/projects/7ea795cb381b49cb9ed8b8240596359c/users/60d2961c887444acb32a3c63ab4708c3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:15.808910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea795cb381b49cb9ed8b8240596359c, user_id=60d2961c887444acb32a3c63ab4708c3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:15.811251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:15.908477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 978/1979] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:15 2022] PUT /identity/v3/projects/7ea795cb381b49cb9ed8b8240596359c/users/60d2961c887444acb32a3c63ab4708c3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:15.912229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:15.974386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b8e23e30fe4248bc7b55b8c86836a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:15.997998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b8e23e30fe4248bc7b55b8c86836a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.014194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b8e23e30fe4248bc7b55b8c86836a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.015697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b8e23e30fe4248bc7b55b8c86836a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.016541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20a517fe-847f-4746-b55d-7432804dcf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b8e23e30fe4248bc7b55b8c86836a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:16.023386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c35f5-85b1-413f-bf02-854309938f03 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.028564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.029198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.029475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.029775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.030422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.034891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.053223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 979/1980] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:16.057380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:16.059132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.079640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64bfa8-b468-4ca5-924f-8c5512d61fee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.084370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.085115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.085400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.085676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] PATH_INFO: `/v3/projects/7ea795cb381b49cb9ed8b8240596359c/users/60d2961c887444acb32a3c63ab4708c3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.089015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea795cb381b49cb9ed8b8240596359c, user_id=60d2961c887444acb32a3c63ab4708c3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.090454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964da7a-29ba-46cc-a449-2e02bc3237dc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.102419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 980/1981] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:16 2022] PUT /identity/v3/projects/7ea795cb381b49cb9ed8b8240596359c/users/60d2961c887444acb32a3c63ab4708c3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:16.108221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1002/1982] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:15 2022] DELETE /identity/v3/users/b6b8e23e30fe4248bc7b55b8c86836a7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:16.114210 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.114445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.114552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.114829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.114925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.115226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.143458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:16.144902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.149994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] MFA Rules not processed for user `60d2961c887444acb32a3c63ab4708c3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:16.151919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.227402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1003/1983] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:16.240321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:16.245015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.269574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 981/1984] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:16.282367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:16.284139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.334567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdbde3-1d7f-4dd9-8609-4496bb1cd9c1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.337819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:16.341156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.341923 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.342276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.342623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.362727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45baa7-d642-454e-8df0-919be25fb53a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.369217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.370128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.371482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.372633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.373446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.373827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.391191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1004/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:16.401839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.405815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.429139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 982/1986] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:16.468298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:16.552921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:16.554493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.571344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58df2-a816-4183-8bf2-4fe03644aaf6 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:16.576180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:16.576824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:16.577104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:16.577399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:16.580111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:16.651657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:16.653156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:16.662560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1005/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:17.383056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.384747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.402956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185913ce-0b56-4925-98b1-c57a42d18609 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.408425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.412724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.412724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.412724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] PATH_INFO: `/v3/projects/5e91bff302474b56865d3d49455de525` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.412724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e91bff302474b56865d3d49455de525)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.414244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:17.599831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e91bff302474b56865d3d49455de525', 'request_id': 'req-3f3fdb90-e0a2-434a-a36a-b99eca983bee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.615687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e91bff302474b56865d3d49455de525', 'request_id': 'req-3f3fdb90-e0a2-434a-a36a-b99eca983bee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.646457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e91bff302474b56865d3d49455de525', 'request_id': 'req-3f3fdb90-e0a2-434a-a36a-b99eca983bee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.712057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] The token cache is being invalidate because project 5e91bff302474b56865d3d49455de525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:17.712590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.714153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.714927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:17.716051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.716445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 983/1988] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:17 2022] DELETE /identity/v3/projects/5e91bff302474b56865d3d49455de525 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:17.721199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:17.722583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:17.738497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43299435-5eaf-4639-93c8-46b49ea9f4e1 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.829943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdb90-e0a2-434a-a36a-b99eca983bee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:17.834867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.835097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:17.835658 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.835914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:17.836200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.836302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:17.836738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] PATH_INFO: `/v3/users/f819412e39c64660bd5a8011adbb19f1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.837086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] PATH_INFO: `/v3/users/4efe9422e2fa4d7f8809cd2a17604b08` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:17.838042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f819412e39c64660bd5a8011adbb19f1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.838390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efe9422e2fa4d7f8809cd2a17604b08)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:17.840190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:17.840627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.039289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f819412e39c64660bd5a8011adbb19f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.052859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f819412e39c64660bd5a8011adbb19f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.060208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f819412e39c64660bd5a8011adbb19f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.060970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f819412e39c64660bd5a8011adbb19f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.061594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f819412e39c64660bd5a8011adbb19f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.095756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:18.098576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efe9422e2fa4d7f8809cd2a17604b08'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.099215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efe9422e2fa4d7f8809cd2a17604b08'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.106054 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efe9422e2fa4d7f8809cd2a17604b08'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.159223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:18.164477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1006/1989] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:17 2022] DELETE /identity/v3/users/f819412e39c64660bd5a8011adbb19f1 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:18.168606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.168606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.215935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efe9422e2fa4d7f8809cd2a17604b08'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.216833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b8c4c2df-7539-4aad-bd40-a9451b565427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efe9422e2fa4d7f8809cd2a17604b08'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.238750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 984/1990] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:17 2022] DELETE /identity/v3/users/4efe9422e2fa4d7f8809cd2a17604b08 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:18.239019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.239377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.239716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.244209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796224a-53a5-4c62-b323-c4d72d741e69 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.263060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:18.264386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.330152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.333623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.333623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.333623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] PATH_INFO: `/v3/users/cd84bac34f7e40449b1ed0caa7fa4fec` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.333623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd84bac34f7e40449b1ed0caa7fa4fec)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.339364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.340281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 985/1991] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:18.351139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.352995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.423937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976a43f-50e2-48ab-bc42-052888052d83 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.428107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.428866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.429150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.429728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.440391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.441877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:18.451390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 986/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:18.555581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd84bac34f7e40449b1ed0caa7fa4fec'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.570455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd84bac34f7e40449b1ed0caa7fa4fec'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.579489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd84bac34f7e40449b1ed0caa7fa4fec'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.580917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd84bac34f7e40449b1ed0caa7fa4fec'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.581310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd84bac34f7e40449b1ed0caa7fa4fec'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:18.674908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1007/1993] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:18 2022] DELETE /identity/v3/users/cd84bac34f7e40449b1ed0caa7fa4fec => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:18.822710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:18.824289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:18.841637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30092ac-9449-4450-8e3a-6ef28ce17cae service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:18.873308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:18.957190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:18.957818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:18.958098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:18.958368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] PATH_INFO: `/v3/projects/77ebf001669641db85a9bba719ec4011` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:18.959480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ebf001669641db85a9bba719ec4011)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:18.961469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.041790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.042801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.058338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45dfae-b37c-4cda-935a-7420c810f54e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.064521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.065301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.065613 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.066081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] PATH_INFO: `/v3/projects/1fa0a5e3ed03424593b0f8f263e726de` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.067367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa0a5e3ed03424593b0f8f263e726de)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.070078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.109506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ebf001669641db85a9bba719ec4011', 'request_id': 'req-42ea7175-31da-46bc-aaae-032c1e6eeb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.119372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ebf001669641db85a9bba719ec4011', 'request_id': 'req-42ea7175-31da-46bc-aaae-032c1e6eeb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.125315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ebf001669641db85a9bba719ec4011', 'request_id': 'req-42ea7175-31da-46bc-aaae-032c1e6eeb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.189876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa0a5e3ed03424593b0f8f263e726de', 'request_id': 'req-5d3b6bef-e829-4110-826d-234489d2e42f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.196073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa0a5e3ed03424593b0f8f263e726de', 'request_id': 'req-5d3b6bef-e829-4110-826d-234489d2e42f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.201669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa0a5e3ed03424593b0f8f263e726de', 'request_id': 'req-5d3b6bef-e829-4110-826d-234489d2e42f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.204772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] The token cache is being invalidate because project 77ebf001669641db85a9bba719ec4011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:19.205067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.205703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.207205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 987/1994] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:18 2022] DELETE /identity/v3/projects/77ebf001669641db85a9bba719ec4011 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:19.211475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.211475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.272621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea7175-31da-46bc-aaae-032c1e6eeb10 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.289181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] The token cache is being invalidate because project 1fa0a5e3ed03424593b0f8f263e726de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5d3b6bef-e829-4110-826d-234489d2e42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1008/1995] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:19 2022] DELETE /identity/v3/projects/1fa0a5e3ed03424593b0f8f263e726de => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f59ab-9a59-4dec-ba9a-b75c8603567a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f59ab-9a59-4dec-ba9a-b75c8603567a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.295170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f59ab-9a59-4dec-ba9a-b75c8603567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.313255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-135f59ab-9a59-4dec-ba9a-b75c8603567a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:19.314484 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-135f59ab-9a59-4dec-ba9a-b75c8603567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.337426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.338267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.338528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.338800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] PATH_INFO: `/v3/projects/fe96e6cd18184ea98bf44d19af498543` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.340143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe96e6cd18184ea98bf44d19af498543)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.342307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.383740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1009/1996] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:19.385353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e229c8-5932-4249-9e58-57a80137b1fb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.385734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e229c8-5932-4249-9e58-57a80137b1fb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.386072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e229c8-5932-4249-9e58-57a80137b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.407517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e2e229c8-5932-4249-9e58-57a80137b1fb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:19.408829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e2e229c8-5932-4249-9e58-57a80137b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.417134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1010/1997] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:19.418393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da325-a123-41e5-b466-769e75ee5ae8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.418681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da325-a123-41e5-b466-769e75ee5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.418952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da325-a123-41e5-b466-769e75ee5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.438928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-859da325-a123-41e5-b466-769e75ee5ae8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:19.440111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-859da325-a123-41e5-b466-769e75ee5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.450169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe96e6cd18184ea98bf44d19af498543', 'request_id': 'req-fb2a4806-a78d-4b07-b3d4-d512a3284f90'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.457493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe96e6cd18184ea98bf44d19af498543', 'request_id': 'req-fb2a4806-a78d-4b07-b3d4-d512a3284f90'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.465106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe96e6cd18184ea98bf44d19af498543', 'request_id': 'req-fb2a4806-a78d-4b07-b3d4-d512a3284f90'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.510712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1011/1998] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:19.513093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.514085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.514782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.537084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:19.538261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.539232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] The token cache is being invalidate because project fe96e6cd18184ea98bf44d19af498543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:19.539528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.540163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.541757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 988/1999] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:19 2022] DELETE /identity/v3/projects/fe96e6cd18184ea98bf44d19af498543 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:19.542518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.543923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.549284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1012/2000] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:19.553450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.554950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.556890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4806-a78d-4b07-b3d4-d512a3284f90 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.561515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.563701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.563701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.563701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.564286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:19.564589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.566237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.567527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf170d0-6229-419f-9441-53be78f4e251 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.572382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.573282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.573601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.573890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] PATH_INFO: `/v3/users/01c3dc4ea90543368c9b38c7819743f1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.575146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c3dc4ea90543368c9b38c7819743f1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.577122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.580838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 989/2001] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:19.581461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.591414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374f0a-ebb5-48d0-b046-a6eb2e2c6d67 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.596291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.596941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.597222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.597489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.598126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:19.598422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.599999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.611565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 990/2002] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:19.612334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.621533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69266-6c88-423c-a753-ac8623f93e89 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.626598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.627155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.627447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.627694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.628298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.630183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.738172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 991/2003] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:19.741786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.772296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c3dc4ea90543368c9b38c7819743f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.784683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c3dc4ea90543368c9b38c7819743f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.792952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c3dc4ea90543368c9b38c7819743f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.793789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c3dc4ea90543368c9b38c7819743f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.794503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c3dc4ea90543368c9b38c7819743f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:19.801651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255afe7-925d-45d8-abf5-f5721f4c16bc admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.806976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:19.807588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:19.807868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:19.808254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:19.808977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:19.811034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:19.872745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1013/2004] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:19 2022] DELETE /identity/v3/users/01c3dc4ea90543368c9b38c7819743f1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:19.875656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.881525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.908141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 992/2005] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:19.914319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:19.917249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:19.976030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309963-4554-49ff-b56e-93993ce38fb8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:19.996737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0a5d-6b46-4c3e-92f8-f7dc53bccc34 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.001864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.002477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.002817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.003053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.003700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.005677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.039208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.039738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.040019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.040289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.040947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.042897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.100557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 993/2006] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:20.104526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.114760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1649-3db9-478c-9f8c-0dfb2603c69d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.119943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.120570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.120898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.121161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.123515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:20.128563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.130244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.137215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1014/2007] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:19 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:20.138275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.147602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 994/2008] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:20.149673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.151606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b07a-47ca-4e6b-b7d5-7e1da03b57a1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.156941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.157531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.161524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.161524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.161524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.161524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.161934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3e41-9d78-4945-8b31-aea4e2d076c6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.166059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.166665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.166949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.167229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.168217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.170025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.175224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1015/2009] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:20.179207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.192886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0f45-833f-483f-b794-a638d8257f17 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.193200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 995/2010] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:20.196217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.198720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.199332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.199632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.199875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.200513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.202546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.210688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d701c2-90f5-4065-a1fe-efcb60f11480 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.214875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1016/2011] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:20.216480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.217401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.217962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.218570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] PATH_INFO: `/v3/projects/db5e04d4f466443aa29ba91f21659ddd/users/460f88282f7441648850c92bfa8a2b66/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.219666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.231344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a5795-68c6-4a80-b6ae-ceecfdd523a1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.236012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.236798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.237086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.237355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] PATH_INFO: `/v3/projects/8e98a329371a4e6c9c9c480929560b25/users/28b29c1ac1ce4cc0a25f7b51afdd1186/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.239836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5e04d4f466443aa29ba91f21659ddd, user_id=460f88282f7441648850c92bfa8a2b66, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.243948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01098e2-8c8f-4694-b326-cb385d714669 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.253985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e98a329371a4e6c9c9c480929560b25, user_id=28b29c1ac1ce4cc0a25f7b51afdd1186, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.256774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1d837-5947-443d-b050-a946d92cc4ae admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.318920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 996/2012] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:20 2022] PUT /identity/v3/projects/db5e04d4f466443aa29ba91f21659ddd/users/460f88282f7441648850c92bfa8a2b66/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:20.323981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.324267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.324543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.342709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:20.344476 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.348580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1017/2013] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:20 2022] PUT /identity/v3/projects/8e98a329371a4e6c9c9c480929560b25/users/28b29c1ac1ce4cc0a25f7b51afdd1186/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:20.359329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.361782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.361782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.392588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] MFA Rules not processed for user `28b29c1ac1ce4cc0a25f7b51afdd1186`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:20.393851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.437152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 997/2014] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:20.438244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.439521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.451659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380863a4-0bd7-42da-bcff-6d9d8acb5ca4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.457094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.457723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.458003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.458275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] PATH_INFO: `/v3/projects/6e9f29da366d403a9db83a9838d4e8b8` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.459434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9f29da366d403a9db83a9838d4e8b8)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.461382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.470822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1018/2015] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:20.474483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.474483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.527942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbb6c1-c268-4dd4-954d-ee554fa3a4c8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.532332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.532967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.533248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.533520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.543018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.544436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.555364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1019/2016] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:20.556211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.557701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.587675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9f29da366d403a9db83a9838d4e8b8', 'request_id': 'req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.594544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9f29da366d403a9db83a9838d4e8b8', 'request_id': 'req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.600393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9f29da366d403a9db83a9838d4e8b8', 'request_id': 'req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.617913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3859-5bcf-4f4c-99ad-4c1cbc87531a service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.667447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.668048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.668327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.668600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.707614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] The token cache is being invalidate because project 6e9f29da366d403a9db83a9838d4e8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:20.707904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.708573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:20.710259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 998/2017] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:20 2022] DELETE /identity/v3/projects/6e9f29da366d403a9db83a9838d4e8b8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:20.714541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:20.716003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:20.729486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=9,keystone:SELECT=85,keystone:INSERT=6 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:20.733567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.735195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:20.745616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1020/2018] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:20.793655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d7e2-db73-4fa3-b90b-0551e63aa9e2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:20.808279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:20.809169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:20.809592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:20.810012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] PATH_INFO: `/v3/users/784a8c9ae7764a6eb1990b736f99e022` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:20.812369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784a8c9ae7764a6eb1990b736f99e022)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:20.816906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.004369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.005827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.023746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e010dd-cdf4-4655-9bff-cd0e370895c0 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.029074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.029866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.030140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.030408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] PATH_INFO: `/v3/users/2a621f419a0741b5b166af0cb87ff3a7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.031713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a621f419a0741b5b166af0cb87ff3a7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.034912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.057990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784a8c9ae7764a6eb1990b736f99e022'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.059413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784a8c9ae7764a6eb1990b736f99e022'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.070819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784a8c9ae7764a6eb1990b736f99e022'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.164284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784a8c9ae7764a6eb1990b736f99e022'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.164959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-03e11cef-9e06-4132-aabb-ba1d8dc7aa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784a8c9ae7764a6eb1990b736f99e022'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.188444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 999/2019] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:20 2022] DELETE /identity/v3/users/784a8c9ae7764a6eb1990b736f99e022 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:21.251138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a621f419a0741b5b166af0cb87ff3a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.267783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a621f419a0741b5b166af0cb87ff3a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.276508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a621f419a0741b5b166af0cb87ff3a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.277492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a621f419a0741b5b166af0cb87ff3a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.278166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a621f419a0741b5b166af0cb87ff3a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:21.361966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1021/2020] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:21 2022] DELETE /identity/v3/users/2a621f419a0741b5b166af0cb87ff3a7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:21.366234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.366783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.367061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.395111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:21.396445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.456299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:21.480902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1000/2021] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:21.488553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.490051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.551830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776a13-0a9c-4cd6-b09c-272b2f79264a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.556889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.557522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.557796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.558063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.569612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.571109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:21.582780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1022/2022] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:21.851759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:21.853225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:21.865124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0fa10-05da-42fb-bdf1-5a5ad6ed9737 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:21.870607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:21.871437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:21.871714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:21.872144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] PATH_INFO: `/v3/projects/bf57b55b3f3a412b898d3d8eb772e123` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:21.873696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf57b55b3f3a412b898d3d8eb772e123)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:21.877038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.016511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf57b55b3f3a412b898d3d8eb772e123', 'request_id': 'req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.036392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf57b55b3f3a412b898d3d8eb772e123', 'request_id': 'req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.042969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf57b55b3f3a412b898d3d8eb772e123', 'request_id': 'req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.153959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] The token cache is being invalidate because project bf57b55b3f3a412b898d3d8eb772e123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:22.154427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.155950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a5184e3c-2bbf-48cd-a053-d0461d6ecdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.156422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.158037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1001/2023] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:21 2022] DELETE /identity/v3/projects/bf57b55b3f3a412b898d3d8eb772e123 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:22.161714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.163469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b3af-5ea3-49c5-ae07-ff4c09e62ec0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.163753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b3af-5ea3-49c5-ae07-ff4c09e62ec0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.164028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b3af-5ea3-49c5-ae07-ff4c09e62ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.185498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7287d-f2ca-4fd6-9f19-743f0bd149d7 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.192027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-89d1b3af-5ea3-49c5-ae07-ff4c09e62ec0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:22.195987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-89d1b3af-5ea3-49c5-ae07-ff4c09e62ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.205479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:22.265474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.266358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.266704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.266982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] PATH_INFO: `/v3/projects/6f94f96c488f4e48900cda6b2d61c80f` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.268152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f94f96c488f4e48900cda6b2d61c80f)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.270238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.292270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1002/2024] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:22.300498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.300895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.301172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.322683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:22.323886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.333920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1003/2025] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:22.337912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.350188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706d97-c7a8-4cbe-826f-8188c971af3e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.355428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.356042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.356315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.356581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.357259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:22.357665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.359879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.376920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1004/2026] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:22.381395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.395187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6883-e088-458e-b094-7b97e42f8a65 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.400081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.400953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.401628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.401628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.402136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.404206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.428155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f94f96c488f4e48900cda6b2d61c80f', 'request_id': 'req-ca856216-d3ae-42ac-9c98-a2a22f48503b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.435111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f94f96c488f4e48900cda6b2d61c80f', 'request_id': 'req-ca856216-d3ae-42ac-9c98-a2a22f48503b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.441995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f94f96c488f4e48900cda6b2d61c80f', 'request_id': 'req-ca856216-d3ae-42ac-9c98-a2a22f48503b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.487797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1005/2027] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:22.491579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.531755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] The token cache is being invalidate because project 6f94f96c488f4e48900cda6b2d61c80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:22.532689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.532822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.534700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1023/2028] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:22 2022] DELETE /identity/v3/projects/6f94f96c488f4e48900cda6b2d61c80f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:22.538244 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.539661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.563642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5b02-96ea-4326-ba98-b709fb1673f9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.568815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.569876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.570105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.570480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.571219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.573282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.608441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856216-d3ae-42ac-9c98-a2a22f48503b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.613610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.614238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.615937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.615937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] PATH_INFO: `/v3/users/d066fb287c8d4e018ecd57a2fd9c156d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.615937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d066fb287c8d4e018ecd57a2fd9c156d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.618032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.674652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1006/2029] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:22.678111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.680309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:22.699371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad18a-3b7b-47da-a5b5-255021d754cb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.720026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.721135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.721625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.722150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.723617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.727134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.743303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1007/2030] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:22.750093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.772475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198bcb9-1962-453e-be50-6f71752847d0 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.776552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:22.782875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.783328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.783624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.783870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.784519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.786226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.800744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1008/2031] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:22.804363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:22.816079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319318-28c5-4909-a7a8-a9493fe15aa1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:22.821174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:22.821956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.822317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.822647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] PATH_INFO: `/v3/projects/0b563a5b94654e099ecab1dcfab777e0/users/0476408e7c004349b535614bbff88962/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.841076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b563a5b94654e099ecab1dcfab777e0, user_id=0476408e7c004349b535614bbff88962, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:22.844863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534666-c098-4b08-9f13-7ca48c03467b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:22.851431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd066fb287c8d4e018ecd57a2fd9c156d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.870392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd066fb287c8d4e018ecd57a2fd9c156d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.879291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd066fb287c8d4e018ecd57a2fd9c156d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.880001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd066fb287c8d4e018ecd57a2fd9c156d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.880600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd066fb287c8d4e018ecd57a2fd9c156d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:22.918118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1009/2032] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:22 2022] PUT /identity/v3/projects/0b563a5b94654e099ecab1dcfab777e0/users/0476408e7c004349b535614bbff88962/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:22.929507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:22.929747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:22.930000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:22.936919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1024/2033] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:22 2022] DELETE /identity/v3/users/d066fb287c8d4e018ecd57a2fd9c156d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:22.972298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] MFA Rules not processed for user `0476408e7c004349b535614bbff88962`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:22.973627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.073071 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1010/2034] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:23.127438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.139387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.221692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247671ac-5253-4c8c-ba66-a2c91e7136c5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.225996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.226867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.227353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.227827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.238298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.240036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.252385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1025/2035] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:23.517712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.519198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:23.541092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:23.645710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea2b1-0daf-4209-8c92-8de76983271b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:23.651846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:23.652548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:23.653349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:23.653976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] PATH_INFO: `/v3/projects/879805c00ada4674a892c3583643a59e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:23.658169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879805c00ada4674a892c3583643a59e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:23.661039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:23.838202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879805c00ada4674a892c3583643a59e', 'request_id': 'req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.853987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879805c00ada4674a892c3583643a59e', 'request_id': 'req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.863421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879805c00ada4674a892c3583643a59e', 'request_id': 'req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.956916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] The token cache is being invalidate because project 879805c00ada4674a892c3583643a59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:23.957483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.958364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:23.959871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1011/2036] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:23 2022] DELETE /identity/v3/projects/879805c00ada4674a892c3583643a59e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:23.965738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:23.978289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622eb24-fbc6-46b4-9295-abc6cd9857f4 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:24.085596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:24.086776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:24.087131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:24.087751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] PATH_INFO: `/v3/users/60d2961c887444acb32a3c63ab4708c3` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:24.089279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d2961c887444acb32a3c63ab4708c3)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:24.091463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:24.330211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:24.380021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d2961c887444acb32a3c63ab4708c3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:24.395241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d2961c887444acb32a3c63ab4708c3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:24.404435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d2961c887444acb32a3c63ab4708c3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:24.405227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d2961c887444acb32a3c63ab4708c3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:24.410641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d2961c887444acb32a3c63ab4708c3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:24.551348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1026/2037] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:23 2022] DELETE /identity/v3/users/60d2961c887444acb32a3c63ab4708c3 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:25.181291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:25.183774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.208200 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:25.210994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.226259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158c0d7-fc1d-4f44-bac9-fbdd381830c8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:25.392221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa1e0-acd9-43f1-bb77-0e16d7435f20 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:25.394877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:25.395982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.397055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.401290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] PATH_INFO: `/v3/users/28b29c1ac1ce4cc0a25f7b51afdd1186` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.401290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b29c1ac1ce4cc0a25f7b51afdd1186)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:25.403113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:25.406171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:25.406348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.406720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.408052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] PATH_INFO: `/v3/projects/7ea795cb381b49cb9ed8b8240596359c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.414444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea795cb381b49cb9ed8b8240596359c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:25.417615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:25.613336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b29c1ac1ce4cc0a25f7b51afdd1186'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.614100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b29c1ac1ce4cc0a25f7b51afdd1186'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.614365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea795cb381b49cb9ed8b8240596359c', 'request_id': 'req-20ee932d-49d2-4520-a37b-caf5b3902a08'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.620888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea795cb381b49cb9ed8b8240596359c', 'request_id': 'req-20ee932d-49d2-4520-a37b-caf5b3902a08'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.622349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b29c1ac1ce4cc0a25f7b51afdd1186'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.627486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea795cb381b49cb9ed8b8240596359c', 'request_id': 'req-20ee932d-49d2-4520-a37b-caf5b3902a08'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.706850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b29c1ac1ce4cc0a25f7b51afdd1186'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.707732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d056c17e-7053-4253-9204-2afc7ed6bfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b29c1ac1ce4cc0a25f7b51afdd1186'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.735147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1012/2038] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:25 2022] DELETE /identity/v3/users/28b29c1ac1ce4cc0a25f7b51afdd1186 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:25.737145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.737435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.737713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.777107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:25.777107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.803979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] The token cache is being invalidate because project 7ea795cb381b49cb9ed8b8240596359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:25.804265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.806896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-20ee932d-49d2-4520-a37b-caf5b3902a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:25.810602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1027/2039] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:25 2022] DELETE /identity/v3/projects/7ea795cb381b49cb9ed8b8240596359c => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:25.817350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c0-102c-4b0e-9991-df3e990874e1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.818256 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c0-102c-4b0e-9991-df3e990874e1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.818536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3930c0-102c-4b0e-9991-df3e990874e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:25.861786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0d3930c0-102c-4b0e-9991-df3e990874e1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:25.864089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0d3930c0-102c-4b0e-9991-df3e990874e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.896226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1013/2040] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:25.908022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:25.909753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:25.965357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1028/2041] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:25.967964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:25.972927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:25.974989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.008024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:26.010512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.013865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585165b-a61b-4e3c-a27d-5588ac99226b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.019103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.019892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.022848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.022848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.032314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.032868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1029/2042] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:26.034194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.037005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.045801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1014/2043] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:26.047758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e4ad-da24-4fe5-99fe-bab006586c6f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.052593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.053394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.053672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.053938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.054607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:26.054886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.056519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.069935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1030/2044] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:26.074599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.086228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1266dc-7259-4138-9b8a-aab6661c6b1c service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.091526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.092185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.093420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.093420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.094428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.096610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.102697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:26.212282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1015/2045] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:26.216558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.227377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:26.228192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89ace-48b9-4e4f-88a3-4fe8f9e2f58a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.332272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.333998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.334469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.335402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.336386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.340631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.463597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1031/2046] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:26.468652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.485482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069c7d-e1ba-4ddd-82ec-ecb9efc8f21b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.496994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.497769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.498051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.498322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.499063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.501186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.533456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.550571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1016/2047] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:26.551348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594114-7357-4f41-9cbc-bf06f204ab66 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.565631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.566507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.566930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.567339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.568163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.569982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a17d-6a6e-407d-aa0a-da7c85323c5e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.591220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.591656 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1032/2048] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:26.606103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15afc-8bd2-4c14-b084-b3274981b510 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.625685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.625685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.625685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.625685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] PATH_INFO: `/v3/projects/a8619e5dd35e4547a228403651154ae5/users/136cd2dfd4844002b2be71d5c75674d6/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.661297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8619e5dd35e4547a228403651154ae5, user_id=136cd2dfd4844002b2be71d5c75674d6, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.664325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.795069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1017/2049] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:26 2022] PUT /identity/v3/projects/a8619e5dd35e4547a228403651154ae5/users/136cd2dfd4844002b2be71d5c75674d6/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:26.815427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.815786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.816092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.820533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.841521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.895801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] MFA Rules not processed for user `136cd2dfd4844002b2be71d5c75674d6`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:26.897150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:26.957438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bbab-42f8-461b-a0b1-680882d98240 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:26.962285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:26.962917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:26.963207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:26.963474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] PATH_INFO: `/v3/projects/8e98a329371a4e6c9c9c480929560b25` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:26.964762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e98a329371a4e6c9c9c480929560b25)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:26.966702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:26.990568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1033/2050] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:26.992266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:26.993595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.007974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a23c86-6c8f-49cd-974c-657394e4ae52 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.013145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.013924 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.014301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.014710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] PATH_INFO: `/v3/users/0476408e7c004349b535614bbff88962` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.015970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0476408e7c004349b535614bbff88962)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.017961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.075126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e98a329371a4e6c9c9c480929560b25', 'request_id': 'req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.083377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e98a329371a4e6c9c9c480929560b25', 'request_id': 'req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.089543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e98a329371a4e6c9c9c480929560b25', 'request_id': 'req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.173642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] The token cache is being invalidate because project 8e98a329371a4e6c9c9c480929560b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:27.173642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.173642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.177643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1018/2051] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:26 2022] DELETE /identity/v3/projects/8e98a329371a4e6c9c9c480929560b25 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:27.180173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.182630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.256716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0476408e7c004349b535614bbff88962'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.284624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0476408e7c004349b535614bbff88962'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.302061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0476408e7c004349b535614bbff88962'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.303110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0476408e7c004349b535614bbff88962'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.303894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b332a01f-b4c2-4f88-b58a-04ea54dcbcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0476408e7c004349b535614bbff88962'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.319229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f494b1-bf76-45d2-8b56-8fd0d0e6d591 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.330699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.331343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.331785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.332075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.332778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.334842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.365984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1034/2052] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:26 2022] DELETE /identity/v3/users/0476408e7c004349b535614bbff88962 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:27.368992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf6a4-908f-4ef8-9e8a-9bb7275f8b3d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.368992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf6a4-908f-4ef8-9e8a-9bb7275f8b3d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.368992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf6a4-908f-4ef8-9e8a-9bb7275f8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.403194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8f9bf6a4-908f-4ef8-9e8a-9bb7275f8b3d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.403194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8f9bf6a4-908f-4ef8-9e8a-9bb7275f8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.468940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1019/2053] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:27.470043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.474420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1035/2054] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.476096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.476528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.476969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.482319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.515012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.516234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.573304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bc00e-fa0a-4f11-849c-43cb05fd3903 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.578993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.579633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.581215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.581215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] PATH_INFO: `/v3/users/b6d02f72a6dc4705b1079e19326ddf5e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.581444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d02f72a6dc4705b1079e19326ddf5e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.583286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.589845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1036/2055] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.597732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.599958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.612162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:27.618937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025b41-8ea9-4faa-93ae-dfc70f51f3c0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.623704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.624509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.624958 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.625239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.625874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.627841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c0c9-f764-415b-b0a2-8923a592f78d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:27.722266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1037/2056] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:27.722266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26965-f3b3-48ae-a730-c9c1279ed471 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.722266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26965-f3b3-48ae-a730-c9c1279ed471 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.722266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26965-f3b3-48ae-a730-c9c1279ed471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.745464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6de26965-f3b3-48ae-a730-c9c1279ed471 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.746699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6de26965-f3b3-48ae-a730-c9c1279ed471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.757593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1038/2057] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.758929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.759215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.759489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.782293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d02f72a6dc4705b1079e19326ddf5e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.782999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d02f72a6dc4705b1079e19326ddf5e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.795832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] MFA Rules not processed for user `460f88282f7441648850c92bfa8a2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:27.798216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.812988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d02f72a6dc4705b1079e19326ddf5e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.890180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1039/2058] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:27.890180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.890475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d02f72a6dc4705b1079e19326ddf5e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.890475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d02f72a6dc4705b1079e19326ddf5e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:27.890696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.908308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1020/2059] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:27 2022] DELETE /identity/v3/users/b6d02f72a6dc4705b1079e19326ddf5e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:27.909647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:27.911479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:27.957902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a42b0-8728-4104-9729-b5841cd64e84 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.986177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109dc83-233a-489b-b02a-bb5472a21875 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:27.991124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:27.991731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:27.992011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:27.992281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:27.992969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:27.994571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.006066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1021/2060] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:28.007001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.008976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.012786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.013393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.013707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.013947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.015694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.021429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74213157-a56e-4c06-bbb8-285db77c56f5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.026503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.027188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.031924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.032045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.032129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.032129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:28.032129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.032380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.032468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3c2f-e59b-4b5b-b96d-df711318c0c1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.038707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1040/2061] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:28.039502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.040872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.047605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1022/2062] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:28.049416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.049871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.050151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.070619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:28.071929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.081159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1023/2063] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:28.082123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.091947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfafdb1-5920-49d5-856c-9ca78dca91b3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.098186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.099106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.099247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.099503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] PATH_INFO: `/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d/users/7e5dca1200e04ac9b768364543f1269a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.117070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3dd7b9c7a045479ddb6076525b9c6d, user_id=7e5dca1200e04ac9b768364543f1269a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.120049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.136647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275080-c6c4-493e-992c-3b260a46f1cc service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.143576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.144192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.144548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.145055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.146818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.181030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1024/2064] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:28 2022] PUT /identity/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d/users/7e5dca1200e04ac9b768364543f1269a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:28.182176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.214194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.215829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.225979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1041/2065] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:28.240080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.252347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.263728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a325312-f6df-4361-bd06-925c076d5739 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.269421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.270277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.270688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.271035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.271892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.276650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.279267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022efb-eb01-40a9-9971-b45f514d71ea service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.353093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.353731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.354011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.354283 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.365260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.367100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.380001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1042/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:28.380990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.385339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1025/2067] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:28.389104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.395975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa755-7fdb-4dd0-85c1-baedd21bd956 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.472492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:28.488432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ff62-60be-4f07-9658-3ab1800faced admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.494758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.495534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.495905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.496245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.496995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.499726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74d56f-08e1-472b-9c18-8d8c843a7c58 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.511621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.511621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.511621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.511621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.512016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.513078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.526917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1043/2068] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:28.527968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.546160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f363-ae3a-402b-9b91-f58218bea2c8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.549263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.550007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.550406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.551027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] PATH_INFO: `/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d/users/7e5dca1200e04ac9b768364543f1269a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.553447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3dd7b9c7a045479ddb6076525b9c6d, user_id=7e5dca1200e04ac9b768364543f1269a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.556298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.571055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1044/2069] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:28 2022] PUT /identity/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d/users/7e5dca1200e04ac9b768364543f1269a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:28.571918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.590207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.611115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1026/2070] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:28.612481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.612809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.613089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.659252 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] MFA Rules not processed for user `7e5dca1200e04ac9b768364543f1269a`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:28.663264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.673202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932e5ec-13fd-4078-ad27-839b61bbbb38 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.683012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.683659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.683941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.684590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] PATH_INFO: `/v3/projects/0b563a5b94654e099ecab1dcfab777e0` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.687194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b563a5b94654e099ecab1dcfab777e0)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.689123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.746305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1027/2071] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:28.747171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.758444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff468f-d89a-427d-b422-e0163ca4046c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.764000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.765378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.765727 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.766082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.766817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:28.768653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:28.783778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1028/2072] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:28.784809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.789860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.828036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b563a5b94654e099ecab1dcfab777e0', 'request_id': 'req-19886fd8-949b-412c-9555-05e77d1876b1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.842000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b563a5b94654e099ecab1dcfab777e0', 'request_id': 'req-19886fd8-949b-412c-9555-05e77d1876b1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.855576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b563a5b94654e099ecab1dcfab777e0', 'request_id': 'req-19886fd8-949b-412c-9555-05e77d1876b1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.865439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:28.905031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f703d7-dc24-4164-8aae-02b82a846809 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:28.964460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] The token cache is being invalidate because project 0b563a5b94654e099ecab1dcfab777e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:28.964786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.967848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:28.969999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1045/2073] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:28 2022] DELETE /identity/v3/projects/0b563a5b94654e099ecab1dcfab777e0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:28.970509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:28.970799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:28.971135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:28.971412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:28.971681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:28.973543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:28.975299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.052163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.053650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ec068-c864-4ab6-8d43-b32acd658e1d service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.072809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1029/2074] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:29.076470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400ecc-9b3e-42a8-92c3-e0d8e85b3dd8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.076810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400ecc-9b3e-42a8-92c3-e0d8e85b3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.077201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400ecc-9b3e-42a8-92c3-e0d8e85b3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.101988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19886fd8-949b-412c-9555-05e77d1876b1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.113222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a9400ecc-9b3e-42a8-92c3-e0d8e85b3dd8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.117079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.117079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.117079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.117488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.118872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.121592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a9400ecc-9b3e-42a8-92c3-e0d8e85b3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.123660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.138825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1030/2075] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.147005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1046/2076] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:29.148328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.149221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.149822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.150538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.178363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e46f-0c2c-43a3-89ef-dd49a67607b3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.185071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.186052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.187001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.187509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] PATH_INFO: `/v3/projects/8fbbcfe7f3af4297bc47ea0461a0b559/users/48bc87302211411fb985ef7b1ccd511b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.195534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.197088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.208418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbbcfe7f3af4297bc47ea0461a0b559, user_id=48bc87302211411fb985ef7b1ccd511b, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.211787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.216122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1031/2077] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.220716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.230091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac86f0-1561-4717-8dde-c4ab79cf1536 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.235078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.235671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.235946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.236217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.236914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:29.237217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.238829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.258571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1032/2078] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:29.259554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.266229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.282522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b5e-faf0-4fc3-ac3c-7028a802866e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.283370 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1047/2079] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:29 2022] PUT /identity/v3/projects/8fbbcfe7f3af4297bc47ea0461a0b559/users/48bc87302211411fb985ef7b1ccd511b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:29.284980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.353015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.353725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.353998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.354267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] PATH_INFO: `/v3/projects/677b39a63ff1480cb120db29a4a4b652` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.355432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=677b39a63ff1480cb120db29a4a4b652)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.357430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.421513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b7a3d-f969-44a4-9a54-c406c6f6120c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.428168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.429185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.429667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.430088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.431253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.433788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94155-eab9-46b6-83ba-042becc0d37e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.491408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677b39a63ff1480cb120db29a4a4b652', 'request_id': 'req-31fb64ad-13a8-4aad-8f8f-32f582a72248'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:29.498221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677b39a63ff1480cb120db29a4a4b652', 'request_id': 'req-31fb64ad-13a8-4aad-8f8f-32f582a72248'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:29.504894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677b39a63ff1480cb120db29a4a4b652', 'request_id': 'req-31fb64ad-13a8-4aad-8f8f-32f582a72248'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:29.526474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1048/2080] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:29.529565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769434c7-58c9-497a-9fb0-505fb1411698 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.529565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769434c7-58c9-497a-9fb0-505fb1411698 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.529565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769434c7-58c9-497a-9fb0-505fb1411698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.554805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-769434c7-58c9-497a-9fb0-505fb1411698 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.556076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-769434c7-58c9-497a-9fb0-505fb1411698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.614374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] The token cache is being invalidate because project 677b39a63ff1480cb120db29a4a4b652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:29.614729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:29.615505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:29.618671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1033/2081] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:29 2022] DELETE /identity/v3/projects/677b39a63ff1480cb120db29a4a4b652 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:29.619297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.621494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.653432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1049/2082] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.656139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.657192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.657608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.684081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.685337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.694039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1050/2083] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.694660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.696069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.708689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb64ad-13a8-4aad-8f8f-32f582a72248 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.715614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.716434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.716650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.716947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.718237 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.720607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb99f-4088-4054-8e57-91f878df27d6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.761500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13089-3d26-4862-8391-6b91959bf08a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.765564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.766234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.766512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.766781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.781059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.782778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.804617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1034/2084] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:29.804617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.804617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.804617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.810734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1051/2085] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:29.810734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.824110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610069c9-f1b2-47bc-af5b-daa58a1cdd2c service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.831076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.831076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.831480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.831480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.832228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.834036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.847828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1052/2086] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:29.852391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:29.852391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:29.853763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.870393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1035/2087] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:29.871146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee082-10cc-4141-a599-bb28e232b849 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.882500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:29.882500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.882500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.882500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.882782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.882782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.887916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.889919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.897457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803ac7-5a97-4a98-adb5-f7cdccf1391a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.903225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.904705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1053/2088] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:29.904847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.904847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.904847 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.913139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:29.913139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.913139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.916734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.919903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1036/2089] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:57:29.925739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:29.928612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b1f3-6e54-4dc2-8e83-84bf71f3d16c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.933391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.934184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.934566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.934910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] PATH_INFO: `/v3/projects/13253378eb5344a595e6770f3e8876d6/users/eac8b8688a634d1398b541391552f418/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.936172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b744b40-96af-4839-8964-69d51bc37006 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:29.942662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:29.943205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:29.943481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:29.943749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:29.944446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.946411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:29.953513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13253378eb5344a595e6770f3e8876d6, user_id=eac8b8688a634d1398b541391552f418, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:29.955979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0043-b752-4100-9d64-200ae682b400 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.024673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1054/2090] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:29 2022] PUT /identity/v3/projects/13253378eb5344a595e6770f3e8876d6/users/eac8b8688a634d1398b541391552f418/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:30.036126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33928d5-312a-453d-848f-d973591080b9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.036427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33928d5-312a-453d-848f-d973591080b9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.036707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33928d5-312a-453d-848f-d973591080b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.047315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:30.055749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1037/2091] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:30.061277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.067092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d33928d5-312a-453d-848f-d973591080b9 None None] MFA Rules not processed for user `eac8b8688a634d1398b541391552f418`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:30.068304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d33928d5-312a-453d-848f-d973591080b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.147566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff1aad-3be7-4cc8-a501-fd880f9d90f9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.159068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.160482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.160950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.161935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.166964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.166964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.195712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1055/2092] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:30.203881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33928d5-312a-453d-848f-d973591080b9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.205930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d33928d5-312a-453d-848f-d973591080b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.298166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1038/2093] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:30 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:30.299596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33928d5-312a-453d-848f-d973591080b9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.303484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.316061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.318023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.318392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.320670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746dd5-7883-4580-8173-f0189218ee03 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.321071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.339286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.340203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.340578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.341317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.341648 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.341766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.344488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.346018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.360998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:30.367787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1056/2094] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:30.372404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1039/2095] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:30.376675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.390476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5591-7d8d-4797-9cb5-f4878b49382b service glance] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.403114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.404823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.405624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.406747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.407614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.410134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84357b31-ab0f-41de-8d87-5c285e974fa5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.427131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1057/2096] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:30.431438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.457296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e5525-d532-4ae0-8571-5add42e0b361 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.465552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.468520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.469513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.470047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] PATH_INFO: `/v3/projects/def97bb8d42c4521b12b260fd5ddf646/users/382e01f8a68c456f919ea4a58df5d822/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.498846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def97bb8d42c4521b12b260fd5ddf646, user_id=382e01f8a68c456f919ea4a58df5d822, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.507246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.596214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1040/2097] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:30 2022] PUT /identity/v3/projects/def97bb8d42c4521b12b260fd5ddf646/users/382e01f8a68c456f919ea4a58df5d822/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:30.607327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.607796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.608480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.647985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] MFA Rules not processed for user `382e01f8a68c456f919ea4a58df5d822`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:30.649218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.685227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.688553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.763773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1058/2098] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:30.784581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:30.784581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:30.790154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72948b86-d9a6-4526-a457-be5ec2e18e94 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.795176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.796594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.797326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.797601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] PATH_INFO: `/v3/users/136cd2dfd4844002b2be71d5c75674d6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.798813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136cd2dfd4844002b2be71d5c75674d6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.800864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.925165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d0104-4b3a-4c58-9fa2-4e218c9ef116 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:30.925165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:30.925165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:30.925165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:30.927588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:30.927588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:30.927588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3aaf9-7181-4375-ac2c-9e213e7fee5d service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:30.966088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1059/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:31.199987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136cd2dfd4844002b2be71d5c75674d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.200853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136cd2dfd4844002b2be71d5c75674d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.223339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136cd2dfd4844002b2be71d5c75674d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.308912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136cd2dfd4844002b2be71d5c75674d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.312042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136cd2dfd4844002b2be71d5c75674d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:31.330494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:31.344511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1041/2100] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:30 2022] DELETE /identity/v3/users/136cd2dfd4844002b2be71d5c75674d6 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:31.346342 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893201a-0f69-4992-8595-1489715e752c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.346736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893201a-0f69-4992-8595-1489715e752c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.347106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893201a-0f69-4992-8595-1489715e752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.376610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-5893201a-0f69-4992-8595-1489715e752c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:31.377994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5893201a-0f69-4992-8595-1489715e752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.471475 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1060/2101] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:31.482657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:31.484195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:31.529455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:31.560167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8a9f-2e42-4d4e-b0af-2ec1795e12e3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:31.567313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:31.568081 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:31.568415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:31.568722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:31.581981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:31.583697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01cdd2-98bd-4b1f-9fc1-273cc4e354cd service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:31.595920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1042/2102] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:32.081086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740019-3608-4c30-803c-3122c81203bf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.081394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740019-3608-4c30-803c-3122c81203bf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.081673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740019-3608-4c30-803c-3122c81203bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.131458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6e740019-3608-4c30-803c-3122c81203bf None None] MFA Rules not processed for user `48bc87302211411fb985ef7b1ccd511b`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:32.133735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6e740019-3608-4c30-803c-3122c81203bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.227578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1061/2103] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:32.230201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.231206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.231710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.255633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740019-3608-4c30-803c-3122c81203bf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:32.257130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] MFA Rules not processed for user `460f88282f7441648850c92bfa8a2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:32.257266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6e740019-3608-4c30-803c-3122c81203bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.259322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.373273 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740019-3608-4c30-803c-3122c81203bf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:32.378698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:32.379339 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.379617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.379886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.391784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:32.393480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:32.393986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1043/2104] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:32.395130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:32.402399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:32.425603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1062/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:57:32.429248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f179b-127d-43f8-8ed1-1628bf21649c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:32.434459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:32.435096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:32.435366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:32.435637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] PATH_INFO: `/v3/projects/a8619e5dd35e4547a228403651154ae5` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:32.441620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8619e5dd35e4547a228403651154ae5)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:32.445000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:32.641527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8619e5dd35e4547a228403651154ae5', 'request_id': 'req-76d30bf9-bf4f-41f7-a490-db082b66b5ef'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.652290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8619e5dd35e4547a228403651154ae5', 'request_id': 'req-76d30bf9-bf4f-41f7-a490-db082b66b5ef'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.668353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8619e5dd35e4547a228403651154ae5', 'request_id': 'req-76d30bf9-bf4f-41f7-a490-db082b66b5ef'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.889765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:32.932308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] The token cache is being invalidate because project a8619e5dd35e4547a228403651154ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:32.932498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.938696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:32.940992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1044/2106] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:32 2022] DELETE /identity/v3/projects/a8619e5dd35e4547a228403651154ae5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:32.944699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:32.962504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66229-43ca-4f81-bd61-b8c6e84cb3e2 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:33.048177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:33.048985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:33.049272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:33.049544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] PATH_INFO: `/v3/users/7e5dca1200e04ac9b768364543f1269a` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:33.051336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5dca1200e04ac9b768364543f1269a)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:33.053023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:33.134901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:33.327535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5dca1200e04ac9b768364543f1269a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.341154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5dca1200e04ac9b768364543f1269a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.350709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5dca1200e04ac9b768364543f1269a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.351580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5dca1200e04ac9b768364543f1269a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.352902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-1115864a-a5b9-4e75-960d-a2ae46bef25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5dca1200e04ac9b768364543f1269a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:33.469582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1063/2107] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:32 2022] DELETE /identity/v3/users/7e5dca1200e04ac9b768364543f1269a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:33.915655 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:33.917313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:33.930482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30bf9-bf4f-41f7-a490-db082b66b5ef admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.000217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.000742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.001030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.001304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] PATH_INFO: `/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.002540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3dd7b9c7a045479ddb6076525b9c6d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.004463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.089706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:34.147304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3dd7b9c7a045479ddb6076525b9c6d', 'request_id': 'req-69df78eb-7a23-4ea3-95eb-0961ece2e178'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:34.153767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3dd7b9c7a045479ddb6076525b9c6d', 'request_id': 'req-69df78eb-7a23-4ea3-95eb-0961ece2e178'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:34.159824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3dd7b9c7a045479ddb6076525b9c6d', 'request_id': 'req-69df78eb-7a23-4ea3-95eb-0961ece2e178'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:34.255897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] The token cache is being invalidate because project 7d3dd7b9c7a045479ddb6076525b9c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:34.256223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:34.257036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-69df78eb-7a23-4ea3-95eb-0961ece2e178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:34.258722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1045/2108] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:33 2022] DELETE /identity/v3/projects/7d3dd7b9c7a045479ddb6076525b9c6d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:34.263617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.263968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.265325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.309955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:34.311760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.392065 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1064/2109] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:34.404967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.404967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.404967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.430368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:34.431798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.445224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:34.447817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1046/2110] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:34.450441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.463398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09ee90-c819-4d2e-9ed7-c3df68421d75 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.469405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.474974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.474974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.474974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.474974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:34.474974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.477612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809cab3-1ec1-400e-98df-5182002ab71e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.497712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.501819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1065/2111] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:34.510736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eec19a-27d1-4e13-b4bf-6b0dbdde4dda None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.517574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.520912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.521225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.521734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.522697 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.524808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.595601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.595879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.596149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.616249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] MFA Rules not processed for user `48bc87302211411fb985ef7b1ccd511b`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:34.617474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:34.621940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1047/2112] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:34.626196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.680987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1066/2113] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:34.695125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc95fa2-650f-44d2-8fd7-b5b155db1773 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.700275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.700921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.701207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.702055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.702701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.704633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.792533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1048/2114] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:34 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:34.801066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.814440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:34.820755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e380bd-522c-473c-ba04-ecc02b9c7462 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.827898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.828546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.828867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.829140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.829791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.832328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.848908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1067/2115] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:34.850133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.862008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e3d3-964c-45c3-ac78-bd7808b54944 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.889667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.890445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.890672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.890937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.892035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.893765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68030b6-636b-4b65-8248-35543e342e84 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:34.906688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1049/2116] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:34.910511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:34.924358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a88a-d07a-4ce7-ba2a-bfdb49f1c4b8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:34.938420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:34.940266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:34.940745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:34.941251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] PATH_INFO: `/v3/projects/b545155e026b46dda02f00bd3e7d1a6d/users/3baaa16a7da74c579493ffc51afaad4c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:34.991599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b545155e026b46dda02f00bd3e7d1a6d, user_id=3baaa16a7da74c579493ffc51afaad4c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:34.991599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.068276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1068/2117] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:34 2022] PUT /identity/v3/projects/b545155e026b46dda02f00bd3e7d1a6d/users/3baaa16a7da74c579493ffc51afaad4c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:35.079665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.080134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.080953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.116131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] MFA Rules not processed for user `3baaa16a7da74c579493ffc51afaad4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:35.117804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:35.193535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1050/2118] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:35.198070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.279925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e205-fbde-43c2-8bd4-680254af96e4 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.284808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.285405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.285718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.285987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.286665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.288738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.416456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1069/2119] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:35.421832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.434275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b628-3864-4da4-857a-987bd5a150bb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.499596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.508055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.508055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.508055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.508055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.508055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.625496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1051/2120] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:35.629905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.648396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc409cc-0c07-4cc3-a660-7d3a74fa282f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.654028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.655054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.655537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.655954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.657250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.660619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.718232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1070/2121] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:35.733418 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.741012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbdbd-6f09-4fa7-af68-81c75f5ce0c8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.747442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.748117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.748991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.749436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] PATH_INFO: `/v3/projects/703e6ecfc671403ca0cd7511b2639c97/users/ce98fd7c9bae415a90f42ef9d196b698/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.788255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703e6ecfc671403ca0cd7511b2639c97, user_id=ce98fd7c9bae415a90f42ef9d196b698, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.788255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.855160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1052/2122] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:35 2022] PUT /identity/v3/projects/703e6ecfc671403ca0cd7511b2639c97/users/ce98fd7c9bae415a90f42ef9d196b698/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:35.859243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.869473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7843-1ebb-49c0-91bc-699765fe6b69 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.927918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.928548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.928862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.929128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.929778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.931398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668c92-b8df-40ed-a2ad-dff921f124c7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.943203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1071/2123] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:35.947630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:35.959683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7930d3-5da8-4529-8fdf-83d85fde1952 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:35.965730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:35.966416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.966699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.966974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] PATH_INFO: `/v3/projects/703e6ecfc671403ca0cd7511b2639c97/users/ce98fd7c9bae415a90f42ef9d196b698/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:35.969124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703e6ecfc671403ca0cd7511b2639c97, user_id=ce98fd7c9bae415a90f42ef9d196b698, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:35.971891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:35.982651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1053/2124] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:35 2022] PUT /identity/v3/projects/703e6ecfc671403ca0cd7511b2639c97/users/ce98fd7c9bae415a90f42ef9d196b698/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:35.994072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:35.994514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:35.994819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.030180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] MFA Rules not processed for user `ce98fd7c9bae415a90f42ef9d196b698`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:36.033870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:36.055814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:36.137939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1072/2125] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:36.149251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:36.151443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:36.220454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e76dac-323c-4bb3-a914-d82af58045b4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:36.224284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:36.234234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:36.234742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:36.236361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:36.237393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:36.311269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:36.312750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:36.323270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1054/2126] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:36.818330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:37.471208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:37.735414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:38.320357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:38.569544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:39.345323 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:39.502226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:40.351879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:40.494866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:40.861551 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:41.191394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:41.593140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:42.011124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:42.012528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:42.024278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228621-893b-48f8-be50-ec81e4798a58 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:42.029868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:42.030830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:42.031166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:42.031502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:42.040994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:42.042619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdc9e-af49-4abb-8de0-0efdeb403244 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:42.053134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1073/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:42.130195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:42.546796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:42.603440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:43.552011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:43.626143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:43.627643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:43.696285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57346-a3c7-4d29-b7cc-8eb37f983951 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:43.701542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:43.702169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:43.702445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:43.702805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] PATH_INFO: `/v3/users/382e01f8a68c456f919ea4a58df5d822` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:43.703944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=382e01f8a68c456f919ea4a58df5d822)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:43.706466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:43.709360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:43.903263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382e01f8a68c456f919ea4a58df5d822'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.904042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382e01f8a68c456f919ea4a58df5d822'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.911840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382e01f8a68c456f919ea4a58df5d822'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.985868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382e01f8a68c456f919ea4a58df5d822'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:43.986713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382e01f8a68c456f919ea4a58df5d822'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.006891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1055/2128] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:43 2022] DELETE /identity/v3/users/382e01f8a68c456f919ea4a58df5d822 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:44.011989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:44.012269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:44.014755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:44.033285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:44.034574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:44.094046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1074/2129] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:44.103820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:44.105241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:44.171972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186147da-f0fe-43c7-b664-c77bc14d6f6b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:44.174060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:44.178651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:44.178651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:44.178651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:44.184744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:44.186242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ca6e-e13d-42b5-bbf2-52ff76754ca9 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:44.195572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1056/2130] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:44.607108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:44.610821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:44.657495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fe501-e41f-4b66-942a-5f2116a7a7c6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:44.681061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:44.681061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:44.681061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:44.681061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] PATH_INFO: `/v3/projects/def97bb8d42c4521b12b260fd5ddf646` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:44.681652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def97bb8d42c4521b12b260fd5ddf646)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:44.681652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:44.842140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def97bb8d42c4521b12b260fd5ddf646', 'request_id': 'req-34063fa1-7075-4f0b-a551-2e4f4f914ac0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.848769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def97bb8d42c4521b12b260fd5ddf646', 'request_id': 'req-34063fa1-7075-4f0b-a551-2e4f4f914ac0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.856897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def97bb8d42c4521b12b260fd5ddf646', 'request_id': 'req-34063fa1-7075-4f0b-a551-2e4f4f914ac0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.946659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] The token cache is being invalidate because project def97bb8d42c4521b12b260fd5ddf646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:44.946945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.947588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34063fa1-7075-4f0b-a551-2e4f4f914ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:44.949415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1075/2131] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:44 2022] DELETE /identity/v3/projects/def97bb8d42c4521b12b260fd5ddf646 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:44.954534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:44.955041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:44.955136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:44.975648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:44.976920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.047008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1057/2132] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:45.054817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.055095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.055367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.081702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:45.082909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.091739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1076/2133] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:45.096446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.106357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d5fa-9b4f-4baa-b1e6-fb72212b3f5a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.111377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.111918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.112199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.112469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.113163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:45.113457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.115082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.127269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1058/2134] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:45.132149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.144500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365c2c3-e1a3-4446-aaa7-9a0378ab1f93 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.149365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.150307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.150653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.150985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.151693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.153719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.203384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:45.260059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1077/2135] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:45.264556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.275584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f05f85-5af3-44bd-a367-7db77f7282ca admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.334942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:45.346386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.347080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.347361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.347654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.348287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.350268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.449571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1059/2136] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:45.453931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.465577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add236cd-0992-42a6-b829-68c8629f940c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.470746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.471347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.471624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.472545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.472726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.474194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.485164 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1078/2137] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:45.489280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.500445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d68115-12e7-473c-a451-0e08f9d5d62c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.505668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.506271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.506544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.506822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.507477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.509118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb37717-36ae-494d-8eeb-122225c7f6e8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.521362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1060/2138] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:57:45.531754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.544194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788202c-d919-4919-8438-f67b4fa5dfea admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:45.550520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:45.551187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.551471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.551744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] PATH_INFO: `/v3/projects/19dc2c582c344b22982c9e6e8897bc3b/users/3cdaa522829044a49f6e7887195b5cc7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.568933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dc2c582c344b22982c9e6e8897bc3b, user_id=3cdaa522829044a49f6e7887195b5cc7, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:45.571401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:45.668580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1079/2139] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:45 2022] PUT /identity/v3/projects/19dc2c582c344b22982c9e6e8897bc3b/users/3cdaa522829044a49f6e7887195b5cc7/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:45.676537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:45.677173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:45.677598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:45.724181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:45.724181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:45.820546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1061/2140] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:45.831081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:45.833299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:46.022902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c8a4-9a95-4b4d-bee4-1721cdc9bf67 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:46.026859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:46.027457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:46.027733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:46.028000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:46.039509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:46.044857 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117997-efaa-45e5-9f8b-58aba0ae4bcd service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:46.051186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1080/2141] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:46.397647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:46.620393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:47.258884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:47.408684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:47.860964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:48.032240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:48.034061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:48.048110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de5a3-4350-496a-81f0-e1139d58d2af None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:48.052978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:48.053737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:48.054159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:48.054479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] PATH_INFO: `/v3/users/3baaa16a7da74c579493ffc51afaad4c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:48.055944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3baaa16a7da74c579493ffc51afaad4c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:48.058138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:48.348981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3baaa16a7da74c579493ffc51afaad4c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:48.349651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3baaa16a7da74c579493ffc51afaad4c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:48.359687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3baaa16a7da74c579493ffc51afaad4c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:48.438935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3baaa16a7da74c579493ffc51afaad4c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:48.439565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3baaa16a7da74c579493ffc51afaad4c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:48.460722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1062/2142] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:48 2022] DELETE /identity/v3/users/3baaa16a7da74c579493ffc51afaad4c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:48.465644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:48.466495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:48.466960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:48.487446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:48.488683 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:48.586313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1081/2143] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:48.593882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:48.596049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:48.672014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada141b-0d91-4817-98b3-486c8208ef71 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:48.688078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:48.689236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:48.689622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:48.690470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:48.726313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:48.727859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:48.783932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1063/2144] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:49.380329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:49.559606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:49.562012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:49.574830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33fafc-76c6-4a62-b4de-a04b1b455138 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:49.584279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:49.585882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:49.586344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:49.592291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] PATH_INFO: `/v3/projects/b545155e026b46dda02f00bd3e7d1a6d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:49.592291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b545155e026b46dda02f00bd3e7d1a6d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:49.592291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:49.752922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b545155e026b46dda02f00bd3e7d1a6d', 'request_id': 'req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:49.759775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b545155e026b46dda02f00bd3e7d1a6d', 'request_id': 'req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:49.765759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b545155e026b46dda02f00bd3e7d1a6d', 'request_id': 'req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:49.871393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] The token cache is being invalidate because project b545155e026b46dda02f00bd3e7d1a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:49.871845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:49.880052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:49.880609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:49.881652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1082/2145] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:49 2022] DELETE /identity/v3/projects/b545155e026b46dda02f00bd3e7d1a6d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:49.893627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c798a-e226-483f-b605-233f46d0b3e8 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:49.993367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:49.994011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:49.994289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:49.994567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] PATH_INFO: `/v3/users/ce98fd7c9bae415a90f42ef9d196b698` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:50.001762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce98fd7c9bae415a90f42ef9d196b698)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:50.003733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:50.045447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:50.226464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce98fd7c9bae415a90f42ef9d196b698'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:50.227474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce98fd7c9bae415a90f42ef9d196b698'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:50.238432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce98fd7c9bae415a90f42ef9d196b698'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:50.299816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce98fd7c9bae415a90f42ef9d196b698'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:50.300615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-de76f773-1b5b-45ef-8c1c-0e7e3446ddb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce98fd7c9bae415a90f42ef9d196b698'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:50.328293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1064/2146] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:57:49 2022] DELETE /identity/v3/users/ce98fd7c9bae415a90f42ef9d196b698 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:51.028531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:51.031671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:51.052353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cad4c-81a2-4b1c-9c1f-1e360254f587 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:51.182577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:51.183315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.184282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.184746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] PATH_INFO: `/v3/projects/703e6ecfc671403ca0cd7511b2639c97` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.190240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703e6ecfc671403ca0cd7511b2639c97)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:51.193050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:51.357710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703e6ecfc671403ca0cd7511b2639c97', 'request_id': 'req-6a31f1af-b2ea-4721-a634-35cbc6b06da5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:51.382597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703e6ecfc671403ca0cd7511b2639c97', 'request_id': 'req-6a31f1af-b2ea-4721-a634-35cbc6b06da5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:51.390403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703e6ecfc671403ca0cd7511b2639c97', 'request_id': 'req-6a31f1af-b2ea-4721-a634-35cbc6b06da5'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:51.466003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] The token cache is being invalidate because project 703e6ecfc671403ca0cd7511b2639c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:57:51.466994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:51.467780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6a31f1af-b2ea-4721-a634-35cbc6b06da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:57:51.475077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1083/2147] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:57:51 2022] DELETE /identity/v3/projects/703e6ecfc671403ca0cd7511b2639c97 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:51.475984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.476479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.476576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.489759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:51.500843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:51.502061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:51.563952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1065/2148] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:57:51.572113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.572691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.572809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.596019 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:51.597876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:51.610047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:51.611018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1084/2149] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:51.621240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd75a-55da-4a7f-a352-7da7bc42c889 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:51.627776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:51.628891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.628891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.628891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.642218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:57:51.642218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:51.642218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:51.659618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1066/2150] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:57:51.663658 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:51.674059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723138a1-0d5b-484e-9965-e3cf550eee16 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:51.694774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:51.698145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.698145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.698145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.698145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:51.698885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:51.835519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1085/2151] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:51 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:51.839779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:51.854364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823809-91b4-44f8-affc-f2273c53116a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:51.923921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:51.924589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:51.924904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:51.925390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:51.926111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:51.928095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:52.079876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1067/2152] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:51 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:52.084022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:52.100906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a43b7-75a1-4a3d-99c2-6bf13cc2100e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:52.107201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:52.108163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:52.108675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:52.109230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:52.110365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:52.113372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:52.125702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1086/2153] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:52.129983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:52.142690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78853b-2067-4348-9abd-32f319cdd805 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:52.148178 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:52.149145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:52.149895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:52.150345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:52.151105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:52.153004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f60936-9425-4c3f-8f88-0bbf416ea479 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:52.182113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1068/2154] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:52.182743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:52.188912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05210efc-3907-4e6a-a7b0-2357abea5c50 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:52.197773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:52.198454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:52.198732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:52.199005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] PATH_INFO: `/v3/projects/2d24a7044d2447a5805e451f648d997e/users/dc6e68624e5f4ae281585fe433040cbc/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:52.219558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d24a7044d2447a5805e451f648d997e, user_id=dc6e68624e5f4ae281585fe433040cbc, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:52.223568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:52.244299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:52.316365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1087/2155] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:52 2022] PUT /identity/v3/projects/2d24a7044d2447a5805e451f648d997e/users/dc6e68624e5f4ae281585fe433040cbc/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:52.321785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34914e-361d-4a69-8b2c-3e6f9a1ae603 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:52.322057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34914e-361d-4a69-8b2c-3e6f9a1ae603 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:52.322332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34914e-361d-4a69-8b2c-3e6f9a1ae603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:52.403113 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ae34914e-361d-4a69-8b2c-3e6f9a1ae603 None None] MFA Rules not processed for user `dc6e68624e5f4ae281585fe433040cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:52.404434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ae34914e-361d-4a69-8b2c-3e6f9a1ae603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:52.530572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1069/2156] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:53.381361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:53.384280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:53.498229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf211-2c01-41b2-9757-36c64b9ac78b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:53.498229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:53.498229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:53.498229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:53.498950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:53.514026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:53.515640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:53.542736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1088/2157] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:54.146089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:54.164238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.164238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.164238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.202552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] MFA Rules not processed for user `3cdaa522829044a49f6e7887195b5cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:57:54.207066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:54.217148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:54.316738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.316855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1070/2158] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:57:54.317468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:54.444578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142656d5-d4ed-4824-8fc4-ecd7e4e11f77 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.454119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.455172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.455777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.456139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.456985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.459774 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.589194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1089/2159] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:57:54.594751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.617393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc701076-42e5-41b4-aa7d-90d727af86e2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.758768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.759372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.759698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.759894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.760570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.762610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.878923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1071/2160] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:57:54 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:57:54.883693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.896372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13cc2-b5cd-4637-a650-f6ecb8f3593a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.905865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.906802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.907372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.907712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.908360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.910136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:54.923277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1090/2161] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:54.927088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:54.940137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329de8c-a014-468f-a027-bdc2118e7ea3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:54.946663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:54.957637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:54.957637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:54.957637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] PATH_INFO: `/v3/projects/019d005d4c4d4e8799368a6fe036cb17/users/5e180380c4104201af7480956f9a3e60/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:54.973760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d005d4c4d4e8799368a6fe036cb17, user_id=5e180380c4104201af7480956f9a3e60, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:54.977114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.055157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1072/2162] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:54 2022] PUT /identity/v3/projects/019d005d4c4d4e8799368a6fe036cb17/users/5e180380c4104201af7480956f9a3e60/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:57:55.059863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.062379 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:55.076402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a84f-220f-41f7-bff9-1370fb3759a6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.161706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.162316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.162593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.162858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.163664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.165428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.177291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1091/2163] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:57:55.198433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:55.209356 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809193-bf41-49ae-976c-8e9f16eb5e7a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:55.215322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:55.216164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:55.216477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:55.217055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] PATH_INFO: `/v3/projects/019d005d4c4d4e8799368a6fe036cb17/users/5e180380c4104201af7480956f9a3e60/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:55.219271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d005d4c4d4e8799368a6fe036cb17, user_id=5e180380c4104201af7480956f9a3e60, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:55.222391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908f868-f50d-40b8-9a04-20dad8d170a5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:55.238594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1073/2164] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:57:55 2022] PUT /identity/v3/projects/019d005d4c4d4e8799368a6fe036cb17/users/5e180380c4104201af7480956f9a3e60/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:57:55.986425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:56.071123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:57.340337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:59.350736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:00.523266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:00.732522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:00.735144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:00.751446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b3f6-1585-4d6e-adb8-ddb04ca399e1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:00.837205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:00.838206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:00.838589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:00.838920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] PATH_INFO: `/v3/users/eac8b8688a634d1398b541391552f418` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:00.840296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac8b8688a634d1398b541391552f418)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:00.843612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:01.100383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac8b8688a634d1398b541391552f418'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:01.113969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac8b8688a634d1398b541391552f418'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:01.120849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac8b8688a634d1398b541391552f418'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:01.121569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac8b8688a634d1398b541391552f418'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:01.122917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac8b8688a634d1398b541391552f418'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:01.201312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:01.225941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1092/2165] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:00 2022] DELETE /identity/v3/users/eac8b8688a634d1398b541391552f418 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:01.229221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:01.229701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:01.230732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:01.257937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:01.259656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:01.410432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1074/2166] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:01.420931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:01.422522 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:01.506854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf6b7-9865-449f-a3ad-d26eafff87ce admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:01.510813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:01.511536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:01.511889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:01.512231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:01.523112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:01.526068 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073023db-04ae-4ace-a8a1-8b22504ad8e2 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:01.539207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1093/2167] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:02.098722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:02.100515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:02.128078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340193-f8d4-47f6-9713-75717f693e98 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:02.136546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:02.137228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.137539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.138135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] PATH_INFO: `/v3/projects/13253378eb5344a595e6770f3e8876d6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.141507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13253378eb5344a595e6770f3e8876d6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:02.144362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:02.308229 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13253378eb5344a595e6770f3e8876d6', 'request_id': 'req-09865cfa-036b-489b-b871-847fe3a11f8f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:02.322124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13253378eb5344a595e6770f3e8876d6', 'request_id': 'req-09865cfa-036b-489b-b871-847fe3a11f8f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:02.342286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13253378eb5344a595e6770f3e8876d6', 'request_id': 'req-09865cfa-036b-489b-b871-847fe3a11f8f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:02.435789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] The token cache is being invalidate because project 13253378eb5344a595e6770f3e8876d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:02.436131 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:02.437554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-09865cfa-036b-489b-b871-847fe3a11f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:02.445748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e060e3-b394-4a50-b1c3-54f6bb85569e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.457013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e060e3-b394-4a50-b1c3-54f6bb85569e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.457013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e060e3-b394-4a50-b1c3-54f6bb85569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.463746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1075/2168] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:02 2022] DELETE /identity/v3/projects/13253378eb5344a595e6770f3e8876d6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:02.524956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-12e060e3-b394-4a50-b1c3-54f6bb85569e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:02.526481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-12e060e3-b394-4a50-b1c3-54f6bb85569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:02.690385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.690670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.690945 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.751185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1094/2169] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:02.761399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.765843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.766438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.788882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] MFA Rules not processed for user `5e180380c4104201af7480956f9a3e60`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:02.790643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:02.801922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:02.803213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:02.837653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1095/2170] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:02.838886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:02.853017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f774-ad4b-4d4f-9106-7cb41c8dfbaa None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:02.869601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:02.872798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.872798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.872798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.873836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:02.874281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:02.894069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:02.917735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1096/2171] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:02.924194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:02.942226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b5a8-e15b-40e2-8000-480406e172f8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:02.947181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:02.947795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:02.948073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:02.948346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:02.949040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:02.950176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1076/2172] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:02.951494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:02.967470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:02.993274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:02.995201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:03.055874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1097/2173] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:02 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:03.061178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:03.105160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81505e2b-4c33-4f95-acc8-475b485d187c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.150581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f278-5a6c-4bb9-adb0-3b295cf24dd2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.158572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.159179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.159460 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.159730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.160369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.162448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.185320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.186076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.186360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.186762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.188796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:03.249043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1098/2174] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:03 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:03.251182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.252885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.253334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:03.263033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1077/2175] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:58:03.264103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3620e3-d103-40be-b532-6d8a63f20b39 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.274198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.275082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.275357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.275622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.276276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.278528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.289978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1099/2176] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:03.294121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:03.305920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d137f-9752-46c8-b307-64b63b7ef006 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.312394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.313106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.313381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.313653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.314312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.315907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15064f86-5e05-4f99-a46d-4b878ecc0bfc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.327410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1078/2177] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:03.331793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:03.343261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d5cb-93bd-49ae-aab5-b5f6d111cd10 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.349121 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.350103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.350390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.350653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] PATH_INFO: `/v3/projects/0f26c547025148aa8cdda9e6178ca89a/users/08dbdc3b11c549ec94cfb5d36306f26f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.381539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f26c547025148aa8cdda9e6178ca89a, user_id=08dbdc3b11c549ec94cfb5d36306f26f, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.384233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.494924 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1100/2178] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:03 2022] PUT /identity/v3/projects/0f26c547025148aa8cdda9e6178ca89a/users/08dbdc3b11c549ec94cfb5d36306f26f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:03.506982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502f78d-2e4a-4085-92f6-85cfd94a7bd9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.507452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502f78d-2e4a-4085-92f6-85cfd94a7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.507815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502f78d-2e4a-4085-92f6-85cfd94a7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.542952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9502f78d-2e4a-4085-92f6-85cfd94a7bd9 None None] MFA Rules not processed for user `08dbdc3b11c549ec94cfb5d36306f26f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:03.544330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9502f78d-2e4a-4085-92f6-85cfd94a7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:03.613819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1079/2179] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:03.626165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:03.627794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:03.689215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13ae7-0cd7-4cbd-8892-ea8cc192f193 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:03.692930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:03.693530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:03.693806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:03.694077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:03.703546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:03.705020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644c7c0-6a89-4487-8090-d5d080218056 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:03.714703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1101/2180] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:03.785564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:05.618857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:05.619586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:05.619586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:05.643061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] MFA Rules not processed for user `08dbdc3b11c549ec94cfb5d36306f26f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:05.651690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:05.653603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1080/2181] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:05.945607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:06.556476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4717c8-d067-4f8b-9636-6c2257a2c62b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:06.557078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4717c8-d067-4f8b-9636-6c2257a2c62b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:06.557272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4717c8-d067-4f8b-9636-6c2257a2c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:06.599398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-de4717c8-d067-4f8b-9636-6c2257a2c62b None None] MFA Rules not processed for user `3cdaa522829044a49f6e7887195b5cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:06.600744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-de4717c8-d067-4f8b-9636-6c2257a2c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:06.706444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1102/2182] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:06.757537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:08.724138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:09.230680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:09.812118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.002292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.631988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:10.774676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.078788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.385136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.549509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.670737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:11.859579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:12.003259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.004743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.072986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ee3aa-c29d-49b8-8b02-b46402c48ef2 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.078669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:12.079300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.079868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.079868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] PATH_INFO: `/v3/users/dc6e68624e5f4ae281585fe433040cbc` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.080982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6e68624e5f4ae281585fe433040cbc)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:12.082918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:12.294039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6e68624e5f4ae281585fe433040cbc'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.294775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6e68624e5f4ae281585fe433040cbc'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.302241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6e68624e5f4ae281585fe433040cbc'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.365734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6e68624e5f4ae281585fe433040cbc'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.366347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6e68624e5f4ae281585fe433040cbc'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:12.372897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:12.389020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1081/2183] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:12 2022] DELETE /identity/v3/users/dc6e68624e5f4ae281585fe433040cbc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:12.393332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.394245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.394731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.415186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:12.416286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.505811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1103/2184] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:12.515191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:12.516712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:12.615738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea098ad-58fb-4639-9267-3a18966ecbe7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:12.619733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:12.620386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:12.620680 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:12.620963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:12.633437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:12.634912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6ea7-ceae-48c4-b68a-d9a5373f86f2 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:12.646477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1082/2185] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:13.157838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.159332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.174170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da433-d270-4f3f-94ee-0a8f57c5a73c None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.179229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.180042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.180472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.181157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] PATH_INFO: `/v3/projects/2d24a7044d2447a5805e451f648d997e` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.181930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d24a7044d2447a5805e451f648d997e)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.184059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.300770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d24a7044d2447a5805e451f648d997e', 'request_id': 'req-878a30b0-54cb-4b7b-b11d-4da7790f4051'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.308821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d24a7044d2447a5805e451f648d997e', 'request_id': 'req-878a30b0-54cb-4b7b-b11d-4da7790f4051'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.316034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d24a7044d2447a5805e451f648d997e', 'request_id': 'req-878a30b0-54cb-4b7b-b11d-4da7790f4051'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.400341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] The token cache is being invalidate because project 2d24a7044d2447a5805e451f648d997e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:13.401072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.401286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-878a30b0-54cb-4b7b-b11d-4da7790f4051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:13.402761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1104/2186] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:13 2022] DELETE /identity/v3/projects/2d24a7044d2447a5805e451f648d997e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:13.408984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.409465 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.409880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.431562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:13.432908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.493661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1083/2187] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:13.502418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.502826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.503138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.525330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:13.526561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:13.535130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1105/2188] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:13.539467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.550654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b48e93-d349-4fbd-8b61-f734a23ea399 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.555632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.556249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.556527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.556827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.557485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:13.557789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.559406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.572756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1084/2189] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:13.578833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.588371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffad9e-026a-479a-b631-5bc3abc2b3dc None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.596034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.596855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.597136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.597405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.598054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.600352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.723083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1106/2190] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:13.723629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.735183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be032-d53b-4696-9dc1-89cab9315687 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.796182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.796398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.796615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.796919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.797591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.799529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.870381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1085/2191] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:13 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:13.874912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.885411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4855da-2ce6-4c41-8ac5-7d31ce58be55 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.890514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.891097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.891376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.891649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.892291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.893906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.904529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1107/2192] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:13.908338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.914627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:13.918872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946dda8-6a5f-4096-8ece-4be131173e97 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.924800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.927139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.927139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.927139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.927139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.928544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d2eff-511f-486d-a9cf-70a1469fb6d7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:13.940124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1086/2193] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:13.944355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:13.955165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddddd8-542c-4a3e-8027-fd892c558bff admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:13.959739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:13.960373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:13.962701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:13.962701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] PATH_INFO: `/v3/projects/867a310d8b544d9dad66d12dc0b1c878/users/3265c5e08a2547faa15ac90a4de9a784/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:13.972621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:13.976463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867a310d8b544d9dad66d12dc0b1c878, user_id=3265c5e08a2547faa15ac90a4de9a784, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:13.979176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.049780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1108/2194] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:13 2022] PUT /identity/v3/projects/867a310d8b544d9dad66d12dc0b1c878/users/3265c5e08a2547faa15ac90a4de9a784/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:14.064544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dce86-2eae-4560-9840-06f594824f09 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.064867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dce86-2eae-4560-9840-06f594824f09 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.065142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dce86-2eae-4560-9840-06f594824f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.093919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-881dce86-2eae-4560-9840-06f594824f09 None None] MFA Rules not processed for user `3265c5e08a2547faa15ac90a4de9a784`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:14.095121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-881dce86-2eae-4560-9840-06f594824f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:14.163644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1087/2195] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:14.168051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.228960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a95b-2823-482e-9816-1652a1d808f6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.233601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.234194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.234470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.234741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.235364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.237300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.358650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1109/2196] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:14 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:14.362637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dce86-2eae-4560-9840-06f594824f09 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.374228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dce86-2eae-4560-9840-06f594824f09 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.431261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.432013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.432172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.432446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.433111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.435191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.520204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1088/2197] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:14 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:58:14.521487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.534151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16675ec-4b91-4c19-91c8-cd530ad4757f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.538968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.543827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.543827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.543827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.543827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.543827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.555100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1110/2198] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:14.559052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.570548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54226-340d-4878-98d1-f8b60936a484 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.578379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.578379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.578379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.578379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.578971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.580700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681eb3c-2419-489b-a790-df4c3e9e0eba admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.595003 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1089/2199] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:14.596467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.608505 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d30a-e9f7-4194-b1e9-4db29db45076 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.613695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.614351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.614630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.614906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] PATH_INFO: `/v3/projects/85570852a4704ca3ba99368597a430a4/users/38c8d2b740c04bd298fc94c8801e611e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.630496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85570852a4704ca3ba99368597a430a4, user_id=38c8d2b740c04bd298fc94c8801e611e, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.633195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:14.772741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1111/2200] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:14 2022] PUT /identity/v3/projects/85570852a4704ca3ba99368597a430a4/users/38c8d2b740c04bd298fc94c8801e611e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:14.784878 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.785170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.785450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.819185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] MFA Rules not processed for user `38c8d2b740c04bd298fc94c8801e611e`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:14.820495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:14.888260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:14.908973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1090/2201] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:14.913666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:14.988815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159828-7650-43d0-9d95-00a677ad4dfb admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:14.993653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:14.994190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:14.994463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:14.994737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:14.995358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:14.997278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.100956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1112/2202] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:14 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:15.105652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.125006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a592d-05b1-4efa-b714-70cf2242cf1f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.208281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.208955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.209227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.209494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.210140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.212254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.315753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1091/2203] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:15.319869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.331203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34449b22-2fdb-4e3c-b813-7dcf3697cfce admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.335871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.336509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.336823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.337095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.337738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.339325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.351436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1113/2204] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:58:15.355694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.367195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb45a1-e8cb-42ab-afcb-35a0003ccec9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.372106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.373455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.373888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.374175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] PATH_INFO: `/v3/projects/4146758246b241dc9bb840a41119d7ff/users/1f2759c5eea841baab5d8b1fcd3c8678/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.391084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146758246b241dc9bb840a41119d7ff, user_id=1f2759c5eea841baab5d8b1fcd3c8678, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.393757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.475724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1092/2205] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:15 2022] PUT /identity/v3/projects/4146758246b241dc9bb840a41119d7ff/users/1f2759c5eea841baab5d8b1fcd3c8678/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:15.479473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.490649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89762-a737-42a3-8443-5cf7c4e08856 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.501148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:15.559360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.560052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.560558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.560948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.561756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.563366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b346d-b38c-4685-9bff-49268bd6edc0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.573667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1114/2206] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:15.582578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.594065 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93e47-fcec-4759-96d6-b9e2128b86c7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.599001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.599710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.600031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.600308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] PATH_INFO: `/v3/projects/4146758246b241dc9bb840a41119d7ff/users/1f2759c5eea841baab5d8b1fcd3c8678/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.602319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146758246b241dc9bb840a41119d7ff, user_id=1f2759c5eea841baab5d8b1fcd3c8678, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.605028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.623436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1093/2207] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:15 2022] PUT /identity/v3/projects/4146758246b241dc9bb840a41119d7ff/users/1f2759c5eea841baab5d8b1fcd3c8678/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:15.627530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.627829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.628103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.665702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] MFA Rules not processed for user `1f2759c5eea841baab5d8b1fcd3c8678`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:15.667131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:15.769410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1115/2208] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:15.787766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:15.790899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:15.883742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fc7d8-0489-47a9-8925-faf28734df4a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:15.887477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:15.888644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:15.888977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:15.889247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:15.957259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:15.958750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:15.962585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:15.972961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1094/2209] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:17.983080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:17.984828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:17.998130 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2505c-8961-4581-b2b5-87565d591b96 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:18.001859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:18.002461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:18.002737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:18.003005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:18.064257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:18.071027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e11b-e468-47fd-961c-712697db29f6 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:18.080294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1116/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:19.588900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:19.601433 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c913a2-9b57-4b62-8a28-5e52c2147581 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:19.606307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:19.606974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:19.607333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:19.607579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:19.619959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:19.621588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df5e02-de74-41d5-aaed-33a968094e54 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:19.631983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1095/2211] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:21.272813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:21.273308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:21.273414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:21.293946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] MFA Rules not processed for user `bd2a46a3fc3c44779e324d28070fb17e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:21.295304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:21.327389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:21.353325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1117/2212] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:21.888616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:21.889653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:21.891069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:21.958872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:21.960096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:22.045894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1096/2213] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:22.145995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:22.148086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:22.233967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787275c7-5e95-49c9-9651-7b41694eacba None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:22.243961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:22.243961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:22.243961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:22.243961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:22.256105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:22.257756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca493a9-be1f-4a50-91b0-db367f8018d7 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:22.281085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1118/2214] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:24.479136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.489375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1df54-fbef-459e-8ce1-b891af3ed901 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.494162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.494786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.495070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.495342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] PATH_INFO: `/v3/users/3265c5e08a2547faa15ac90a4de9a784` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.496470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3265c5e08a2547faa15ac90a4de9a784)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:24.498416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:24.665347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3265c5e08a2547faa15ac90a4de9a784'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:24.665987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3265c5e08a2547faa15ac90a4de9a784'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:24.673546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3265c5e08a2547faa15ac90a4de9a784'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:24.770845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3265c5e08a2547faa15ac90a4de9a784'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:24.771466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3265c5e08a2547faa15ac90a4de9a784'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:24.802880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1097/2215] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:24 2022] DELETE /identity/v3/users/3265c5e08a2547faa15ac90a4de9a784 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:24.810825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.811724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.812380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.833266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:24.834704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:24.905850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1119/2216] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:24.916316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:24.917738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:24.982564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec867f-2a3a-4b83-8bac-909251fe6059 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:24.991522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:24.991522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:24.991522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:24.991522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:24.998117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.000249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.005303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:25.010206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1098/2217] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:25.425667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.427037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:25.449850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033e151-7e96-4614-8f42-1a393faaa151 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.457116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.458162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.458623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.459003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] PATH_INFO: `/v3/projects/867a310d8b544d9dad66d12dc0b1c878` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.460415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] RBAC: Authorizing `identity:delete_project(project_id=867a310d8b544d9dad66d12dc0b1c878)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.462615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.570961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867a310d8b544d9dad66d12dc0b1c878', 'request_id': 'req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.578289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867a310d8b544d9dad66d12dc0b1c878', 'request_id': 'req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.582660 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:25.586194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867a310d8b544d9dad66d12dc0b1c878', 'request_id': 'req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.682564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] The token cache is being invalidate because project 867a310d8b544d9dad66d12dc0b1c878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:25.683756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.683756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.685761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1120/2218] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:25 2022] DELETE /identity/v3/projects/867a310d8b544d9dad66d12dc0b1c878 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:25.690378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:25.704514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143907a5-dd34-4521-a6c1-f51793a29346 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:25.773506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:25.774736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:25.774870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:25.775165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] PATH_INFO: `/v3/users/38c8d2b740c04bd298fc94c8801e611e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:25.776369 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c8d2b740c04bd298fc94c8801e611e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:25.779391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:25.941299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c8d2b740c04bd298fc94c8801e611e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.942133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c8d2b740c04bd298fc94c8801e611e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:25.949648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c8d2b740c04bd298fc94c8801e611e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.012320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c8d2b740c04bd298fc94c8801e611e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.012988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c8d2b740c04bd298fc94c8801e611e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.038132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1099/2219] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:25 2022] DELETE /identity/v3/users/38c8d2b740c04bd298fc94c8801e611e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:26.425966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:26.427526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:26.442192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba537b3-a8f9-47dd-8ac7-79bde43d993f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:26.515385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:26.516237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:26.516512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:26.516811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] PATH_INFO: `/v3/projects/85570852a4704ca3ba99368597a430a4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:26.517925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85570852a4704ca3ba99368597a430a4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:26.519851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:26.633042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85570852a4704ca3ba99368597a430a4', 'request_id': 'req-867c7421-788e-4420-b4a6-0890e0f8521b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.641248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85570852a4704ca3ba99368597a430a4', 'request_id': 'req-867c7421-788e-4420-b4a6-0890e0f8521b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.651371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85570852a4704ca3ba99368597a430a4', 'request_id': 'req-867c7421-788e-4420-b4a6-0890e0f8521b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.730782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] The token cache is being invalidate because project 85570852a4704ca3ba99368597a430a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:26.735492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.735492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-867c7421-788e-4420-b4a6-0890e0f8521b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:26.735492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1121/2220] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:26 2022] DELETE /identity/v3/projects/85570852a4704ca3ba99368597a430a4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:26.737755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:26.739362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:26.752857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f164480-0c67-4b2e-9952-01708feb416c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:26.830145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:26.830904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:26.831289 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:26.831693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] PATH_INFO: `/v3/users/1f2759c5eea841baab5d8b1fcd3c8678` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:26.833200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2759c5eea841baab5d8b1fcd3c8678)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:26.835567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:26.860445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:27.092344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2759c5eea841baab5d8b1fcd3c8678'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.093163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2759c5eea841baab5d8b1fcd3c8678'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.101102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2759c5eea841baab5d8b1fcd3c8678'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.169826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694fce3-281d-44e5-be4a-cbb0938e94df None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.170102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694fce3-281d-44e5-be4a-cbb0938e94df None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.170372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694fce3-281d-44e5-be4a-cbb0938e94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.182337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2759c5eea841baab5d8b1fcd3c8678'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.182946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2759c5eea841baab5d8b1fcd3c8678'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:27.203355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6694fce3-281d-44e5-be4a-cbb0938e94df None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:27.204418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6694fce3-281d-44e5-be4a-cbb0938e94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.219103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1100/2221] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:26 2022] DELETE /identity/v3/users/1f2759c5eea841baab5d8b1fcd3c8678 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:27.228021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1122/2222] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:27.248381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:27.250460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.403914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df837f3c-f52c-4a2a-874a-6ae43646edb4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:27.410562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:27.411022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.411253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.411505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.427557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.428227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.428227 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.449760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:27.451313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.493451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:27.496027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:27.512364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1101/2223] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:27.560003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1123/2224] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:27.616362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:27.617952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.665560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:27.713634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12a8db-5f0f-4173-97af-da4076384755 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:27.719230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:27.724877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.725387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.725668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.734624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:27.736063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476675b-2c0c-4da9-bad1-22faf09b907e service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:27.744568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1102/2225] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:27.786473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:27.788289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:27.826467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89550-62d0-492c-973f-58ecb3dacf95 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:27.836372 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:27.837137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:27.837420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:27.837691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] PATH_INFO: `/v3/projects/4146758246b241dc9bb840a41119d7ff` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:27.838891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4146758246b241dc9bb840a41119d7ff)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:27.841443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:27.861489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:28.229056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4146758246b241dc9bb840a41119d7ff', 'request_id': 'req-71d6ae77-5051-48f6-ac77-03e35cbce225'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.243826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4146758246b241dc9bb840a41119d7ff', 'request_id': 'req-71d6ae77-5051-48f6-ac77-03e35cbce225'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.252399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4146758246b241dc9bb840a41119d7ff', 'request_id': 'req-71d6ae77-5051-48f6-ac77-03e35cbce225'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.462540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] The token cache is being invalidate because project 4146758246b241dc9bb840a41119d7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:28.463240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.464057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-71d6ae77-5051-48f6-ac77-03e35cbce225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:28.468766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1124/2226] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:27 2022] DELETE /identity/v3/projects/4146758246b241dc9bb840a41119d7ff => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:28.473685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56f76-7384-45f6-865a-2415915465bb None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.473937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56f76-7384-45f6-865a-2415915465bb None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.474353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56f76-7384-45f6-865a-2415915465bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.518854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-60e56f76-7384-45f6-865a-2415915465bb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:28.520553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-60e56f76-7384-45f6-865a-2415915465bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:28.676553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1103/2227] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:28.684321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.684930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.685374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.715817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:28.717250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:28.726956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1125/2228] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:28.731169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56f76-7384-45f6-865a-2415915465bb None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.754188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56f76-7384-45f6-865a-2415915465bb None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.770424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.771391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.772192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.772600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.774190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:58:28.774833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.777777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.803605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1104/2229] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 14:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:58:28.804679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.822729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1f4a9-d916-4545-9433-62314afe23cb None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:28.834444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:28.838552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:28.838552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:28.838552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:28.838552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:28.840132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:28.975489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1126/2230] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:28.976684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:28.987587 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7492f-df5f-4a92-a8dc-a0619f41b8fb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.150606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.152135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.152578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.153027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.154662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.158554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.257574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1105/2231] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 14:58:28 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:58:29.257883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:29.270993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab8451-b628-4c6b-8f98-e69895e2f6c5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.279088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.282633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.282633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.282633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.282633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.283022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.318206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1127/2232] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:29.320502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:29.334836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057389f-372e-4cf5-8747-41f610c5954b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.343736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.344376 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.344638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.345021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.345739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.347537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142f66-dac1-4914-9ccd-41cd8ee77b58 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.367257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1106/2233] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 14:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:58:29.368369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:29.380807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92406c-4e4d-493d-bd41-339463a8e8eb admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.385920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.386611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.386886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.387157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] PATH_INFO: `/v3/projects/9bb282de1d6942089bbb82ff19d4a898/users/2fa2331bdbf147f19ff2f58c2a7abc0f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.418021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb282de1d6942089bbb82ff19d4a898, user_id=2fa2331bdbf147f19ff2f58c2a7abc0f, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.435676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.548957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1128/2234] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 14:58:29 2022] PUT /identity/v3/projects/9bb282de1d6942089bbb82ff19d4a898/users/2fa2331bdbf147f19ff2f58c2a7abc0f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:58:29.626844 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.627140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.627436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.669578 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] MFA Rules not processed for user `2fa2331bdbf147f19ff2f58c2a7abc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:29.670859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:29.692099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:29.816089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1107/2235] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:29.827745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:29.831288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:29.924212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00f52-7378-4747-badd-34680e0b78e8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:29.929603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:29.930610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:29.931752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:29.931752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:29.944101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:29.945922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30725b-4e62-4fb8-ad40-6ef67f211d06 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:29.959255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1129/2236] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:30.010890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:30.119509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744048f-34c2-47b1-9f37-7ab75192b249 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:30.125478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:30.126228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:30.126584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:30.127045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] PATH_INFO: `/v3/users/2fa2331bdbf147f19ff2f58c2a7abc0f` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:30.128312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa2331bdbf147f19ff2f58c2a7abc0f)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:30.130407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:30.407875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa2331bdbf147f19ff2f58c2a7abc0f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:30.408565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa2331bdbf147f19ff2f58c2a7abc0f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:30.416489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa2331bdbf147f19ff2f58c2a7abc0f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:30.521143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa2331bdbf147f19ff2f58c2a7abc0f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:30.522363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa2331bdbf147f19ff2f58c2a7abc0f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:30.561265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1108/2237] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:30 2022] DELETE /identity/v3/users/2fa2331bdbf147f19ff2f58c2a7abc0f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:30.568263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:30.568890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:30.569196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:30.606718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:30.609424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:30.704485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:30.741096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1130/2238] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:30.752022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:30.754096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:30.820398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:30.850706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd496-f6e4-4327-b138-cc35db5423a3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:30.886080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:30.886745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:30.887023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:30.887295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:30.901615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:30.903059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f02060-aa92-4ce8-beb3-927589cd612a service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:30.943306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1109/2239] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:31.913619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:31.918245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:31.929371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e803a-e4d8-4ee5-8f35-0c96c1a7eb62 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:31.934620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:31.935278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:31.935897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:31.937135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] PATH_INFO: `/v3/projects/9bb282de1d6942089bbb82ff19d4a898` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:31.938491 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb282de1d6942089bbb82ff19d4a898)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:31.940466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:32.079649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb282de1d6942089bbb82ff19d4a898', 'request_id': 'req-b186f2ee-860d-445c-947f-91ef23b79881'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:32.094401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb282de1d6942089bbb82ff19d4a898', 'request_id': 'req-b186f2ee-860d-445c-947f-91ef23b79881'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:32.102627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb282de1d6942089bbb82ff19d4a898', 'request_id': 'req-b186f2ee-860d-445c-947f-91ef23b79881'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:32.219058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] The token cache is being invalidate because project 9bb282de1d6942089bbb82ff19d4a898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:32.219365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:32.220092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:32.221901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1131/2240] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:31 2022] DELETE /identity/v3/projects/9bb282de1d6942089bbb82ff19d4a898 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:34.071837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81612bf-9b1f-46de-9ab3-41589dd16d0b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:34.072406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81612bf-9b1f-46de-9ab3-41589dd16d0b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:34.072406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81612bf-9b1f-46de-9ab3-41589dd16d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:34.094803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f81612bf-9b1f-46de-9ab3-41589dd16d0b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:34.096343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f81612bf-9b1f-46de-9ab3-41589dd16d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:34.163656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1110/2241] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:34.181572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:34.183397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:34.275144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f2ee-860d-445c-947f-91ef23b79881 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:34.281401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:34.282016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:34.282294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:34.282565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:34.294248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:34.296223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:34.312694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1132/2242] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:38.555041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8be83-6cd7-4ca0-b14f-aa6206fca209 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:38.555643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8be83-6cd7-4ca0-b14f-aa6206fca209 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:38.555759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8be83-6cd7-4ca0-b14f-aa6206fca209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:38.580900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d3f8be83-6cd7-4ca0-b14f-aa6206fca209 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:38.582015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d3f8be83-6cd7-4ca0-b14f-aa6206fca209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:38.675249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1111/2243] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:38.687959 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:38.690783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:38.759644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:38.788145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d84d-6921-4ec4-93f5-69c7e9c44fe0 service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:38.793942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:38.796165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:38.796617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:38.797066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:38.813010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:38.823097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:38.824445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1133/2244] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:40.829492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65386-a98a-4339-a81e-9b9ac1306ec6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:40.830035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65386-a98a-4339-a81e-9b9ac1306ec6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:40.830035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65386-a98a-4339-a81e-9b9ac1306ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:40.850688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b0a65386-a98a-4339-a81e-9b9ac1306ec6 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:40.851904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b0a65386-a98a-4339-a81e-9b9ac1306ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:40.863511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1112/2245] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:40.876323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:40.887444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570e76-0b62-421b-bc1d-51fe243fee0a service swift] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:40.893761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:40.894387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:40.894664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:40.894932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:40.903765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:40.905577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:40.913954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1134/2246] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:41.548870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf89d-8336-4343-aa31-b66f6c562e96 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:41.549164 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf89d-8336-4343-aa31-b66f6c562e96 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:41.549443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf89d-8336-4343-aa31-b66f6c562e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:41.569859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-1bfcf89d-8336-4343-aa31-b66f6c562e96 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:41.571093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1bfcf89d-8336-4343-aa31-b66f6c562e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:41.579287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1113/2247] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:58:41.591226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:41.603365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb4a0-98dd-4875-bc44-7f8593effa87 service swift] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:41.608538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:41.609156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:41.609434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:41.609700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:41.617832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:41.619414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:41.627982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1135/2248] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:42.232837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:42.233337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:42.233429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:42.252718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:42.253920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:42.261579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1114/2249] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 14:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:42.276436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:42.288041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de0bee-ba7a-41a6-8a66-2e5b09ddd9c4 service swift] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:42.295544 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:42.296127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:42.296400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:42.296686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:42.305996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:42.307559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44f39f-7b21-4a53-b357-a53368761869 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:42.315867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1136/2250] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:45.002258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:45.004545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:45.020872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80592f9-1acd-4d6c-b2d1-12f80a67dd84 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:45.026074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:45.026797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:45.027192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:45.027479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] PATH_INFO: `/v3/users/08dbdc3b11c549ec94cfb5d36306f26f` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:45.028835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08dbdc3b11c549ec94cfb5d36306f26f)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:45.031777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:45.268261 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08dbdc3b11c549ec94cfb5d36306f26f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.269224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08dbdc3b11c549ec94cfb5d36306f26f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.276469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08dbdc3b11c549ec94cfb5d36306f26f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.279563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:45.360047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08dbdc3b11c549ec94cfb5d36306f26f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.360605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08dbdc3b11c549ec94cfb5d36306f26f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.378461 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1115/2251] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 14:58:45 2022] DELETE /identity/v3/users/08dbdc3b11c549ec94cfb5d36306f26f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:45.384493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:45.385051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:45.385051 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:45.406872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:45.408093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:45.473833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1137/2252] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:45.484152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:45.486013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:45.549995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300574b9-faeb-4f57-90cd-b932d4e24938 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:45.553951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:45.554563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:45.555024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:45.555305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:45.565408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:45.567068 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d27050-359b-4f35-b3a9-9e8b4cb1c5ff service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:45.577640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1116/2253] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:45.818838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:45.822041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:45.851814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117d60-82ec-4d87-987e-2b3770440756 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:45.865734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:45.866366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:45.866803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:45.867224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] PATH_INFO: `/v3/projects/0f26c547025148aa8cdda9e6178ca89a` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:45.868533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f26c547025148aa8cdda9e6178ca89a)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:45.870803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:45.990196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f26c547025148aa8cdda9e6178ca89a', 'request_id': 'req-d656275f-2d5d-4894-8806-cf6641ef6773'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:45.996852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f26c547025148aa8cdda9e6178ca89a', 'request_id': 'req-d656275f-2d5d-4894-8806-cf6641ef6773'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:46.003381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f26c547025148aa8cdda9e6178ca89a', 'request_id': 'req-d656275f-2d5d-4894-8806-cf6641ef6773'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:46.074657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] The token cache is being invalidate because project 0f26c547025148aa8cdda9e6178ca89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:58:46.075077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:46.075799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:58:46.077529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1138/2254] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 14:58:45 2022] DELETE /identity/v3/projects/0f26c547025148aa8cdda9e6178ca89a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:58:46.342097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b997-bf44-4511-bae9-fac6181c319d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:46.342652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b997-bf44-4511-bae9-fac6181c319d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:46.342652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b997-bf44-4511-bae9-fac6181c319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:46.364175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3602b997-bf44-4511-bae9-fac6181c319d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:46.365430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3602b997-bf44-4511-bae9-fac6181c319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:46.430194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1117/2255] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:46.471823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:46.473900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:46.502263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:46.557956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656275f-2d5d-4894-8806-cf6641ef6773 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:46.564848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:46.565470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:46.565752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:46.566027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:46.575195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:46.577465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8464e22-308f-40f4-93af-1770665e09e3 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:46.590036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1139/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:52.378971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.379480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.379926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.381968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1118/2257] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:58:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:58:52.392527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04860-e360-4f61-8f07-d6dd72ecd492 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.393081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04860-e360-4f61-8f07-d6dd72ecd492 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.396474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04860-e360-4f61-8f07-d6dd72ecd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.418031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e1a04860-e360-4f61-8f07-d6dd72ecd492 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:52.419350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e1a04860-e360-4f61-8f07-d6dd72ecd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:52.429996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1140/2258] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:52.443264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:52.445494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:52.550438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443e7a-4b2c-4718-8e5c-a6874c1c3a1a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:52.555990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:52.555990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.555990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.556377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.568635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:52.570139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9bf5b-d403-4d17-aae9-bfe09223a3ed service glance] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:52.585896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1119/2259] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:52.812504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.812819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.813141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] PATH_INFO: `/` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.814529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1141/2260] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:58:52.820070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1483-e150-4e9e-a0d6-37b9c4765233 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.820360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1483-e150-4e9e-a0d6-37b9c4765233 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.820634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1483-e150-4e9e-a0d6-37b9c4765233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.843339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-36bf1483-e150-4e9e-a0d6-37b9c4765233 None None] MFA Rules not processed for user `01a1375198434203bce21325c7b82c66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:52.844814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-36bf1483-e150-4e9e-a0d6-37b9c4765233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:52.863273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:52.907529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1120/2261] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:52.924154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:52.926746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:52.943136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2073f7-19e3-4192-a3f2-2612c16fcfe3 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:52.946950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:52.947606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:52.947886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:52.948156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:52.959437 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:52.961020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba259ba8-fc0e-4cfa-8033-62e33b92fead service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:52.972168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1142/2262] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:53.074768 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.075182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.080000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] PATH_INFO: `/` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.080000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1121/2263] 10.222.0.13 () {54 vars in 921 bytes} [Tue Aug 30 14:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:58:53.085791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aae1c-0dcd-4c50-8a24-e1f367a3c735 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.086258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aae1c-0dcd-4c50-8a24-e1f367a3c735 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.086534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aae1c-0dcd-4c50-8a24-e1f367a3c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.107152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-da8aae1c-0dcd-4c50-8a24-e1f367a3c735 None None] MFA Rules not processed for user `200f4c80511443c4bc7315a450a917e3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:53.108533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-da8aae1c-0dcd-4c50-8a24-e1f367a3c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:53.117912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1143/2264] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Aug 30 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:53.129859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:53.131529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:53.145200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28382ed6-ec9a-4296-8808-80eb44be0b5b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:53.149180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:53.149841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.150497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.150880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.161444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:53.162885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:53.173842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1122/2265] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:58:53.734865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18281a-4165-46e3-8580-82e76f742b06 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.735387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18281a-4165-46e3-8580-82e76f742b06 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.735387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18281a-4165-46e3-8580-82e76f742b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.756036 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3e18281a-4165-46e3-8580-82e76f742b06 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:58:53.757297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3e18281a-4165-46e3-8580-82e76f742b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:53.766667 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1144/2266] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:58:53.781843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:58:53.783370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:58:53.798460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba602c-5e19-443b-ae39-e6c82a5babee service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:58:53.805202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:58:53.805814 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:58:53.806094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:58:53.806363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:58:53.816548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:58:53.818158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:58:53.828817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1123/2267] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:01.124867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:01.125374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:01.125478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:01.145963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:01.147359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:01.156720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1145/2268] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:01.173589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:01.189450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857f49-348c-4fac-a6d5-62385e704763 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:01.196475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:01.197109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:01.201960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:01.201960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:01.207207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:01.208908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9e8f-bee0-4586-9744-56340529cb17 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:01.219506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1124/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:01.825085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:01.835616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b449-fca2-4afe-a82f-f45b8348bbc7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:01.839282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:01.839880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:01.840157 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:01.840464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:01.844746 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:01.912779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:01.914215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f34b-c26b-4711-95e2-3017aeab2a80 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:01.924564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1146/2270] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:02.062764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:02.063331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:02.063608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:02.083464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] MFA Rules not processed for user `460f88282f7441648850c92bfa8a2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:02.085728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:02.166588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1125/2271] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:59:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:04.213320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:04.213963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:04.213963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:04.235338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:04.236559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:04.325669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1147/2272] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:04.339481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:04.341055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:04.438668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68dbac-83d9-4019-91bd-8b89d23870f0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:04.444447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:04.445188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:04.445561 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:04.445906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:04.457752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:04.459875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8a7d1-9c81-410d-98c4-22b0b9339c2a service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:04.473596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1126/2273] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:59:14.303866 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:14.470367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=88 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:15.525773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:15.527196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:15.598177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffb847-518a-48fd-bac5-b1b4f64bde8f None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:15.603478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:15.604086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:15.604341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:15.604607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:15.606345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:15.623819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:15.623819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:15.631869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1148/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:24.864630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026400-7d45-45fc-9cea-6f056d80e477 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:24.865151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026400-7d45-45fc-9cea-6f056d80e477 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:24.865488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026400-7d45-45fc-9cea-6f056d80e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:24.887608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2d026400-7d45-45fc-9cea-6f056d80e477 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:24.889154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2d026400-7d45-45fc-9cea-6f056d80e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:24.899231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1127/2275] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 14:59:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:24.917963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:24.932225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b5c5-fb02-4344-977a-73a3745172f9 service placement] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:24.937580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:24.940307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:24.940307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:24.940307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:24.948209 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:24.950623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150834a-88d4-41cb-88ab-f02dedc86262 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:24.962592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1149/2276] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 14:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:59:30.181388 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:30.181941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:30.181941 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:30.201580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] MFA Rules not processed for user `48bc87302211411fb985ef7b1ccd511b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:30.202881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:30.277257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1128/2277] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:34.957861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=38 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:40.269012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=28 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:52.874929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ba7-7486-4bb6-a479-3d90207cc0ec None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:52.875542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ba7-7486-4bb6-a479-3d90207cc0ec None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:52.875542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ba7-7486-4bb6-a479-3d90207cc0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:52.897503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-df024ba7-7486-4bb6-a479-3d90207cc0ec None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:52.898975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-df024ba7-7486-4bb6-a479-3d90207cc0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:52.907515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1150/2278] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:52.927095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:52.940186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ead16-11cc-42f6-9783-cd8c6b6b6fbc None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:52.947808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:52.953086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:52.953086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:52.953086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:52.958672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:52.960291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:52.969846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1129/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:59:57.307187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe99b-2234-469f-8ebe-5bef93738e2b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:57.307788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe99b-2234-469f-8ebe-5bef93738e2b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:57.307895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe99b-2234-469f-8ebe-5bef93738e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:57.327290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e1fbe99b-2234-469f-8ebe-5bef93738e2b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:59:57.328464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e1fbe99b-2234-469f-8ebe-5bef93738e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:59:57.337082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1151/2280] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:59:57.351806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:59:57.363002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f256338-0d47-4aee-8d90-2c195804ba97 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:59:57.369236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:59:57.369823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:59:57.370106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:59:57.370381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:59:57.378687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:59:57.380560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9fe2-f70a-4455-824e-000efe07e506 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:59:57.390043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1130/2281] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:00.228229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:00.228802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:00.228802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:00.249255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] MFA Rules not processed for user `bd2a46a3fc3c44779e324d28070fb17e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:00.250441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:00.303867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1152/2282] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:02.368496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3305b-02d7-45d6-a30f-ce5a70742d68 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:02.369042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3305b-02d7-45d6-a30f-ce5a70742d68 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:02.369593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3305b-02d7-45d6-a30f-ce5a70742d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:02.390138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ecc3305b-02d7-45d6-a30f-ce5a70742d68 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:02.391385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ecc3305b-02d7-45d6-a30f-ce5a70742d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:02.400002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1131/2283] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:02.417251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:02.430558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485740b1-d82f-45ce-a90a-602105af5fb2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:02.435957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:02.436576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:02.436894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:02.437169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:02.445502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:02.447076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:02.456749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1153/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:07.696154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597a6e-9f43-49d8-aea0-429446b554ad None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:07.696645 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597a6e-9f43-49d8-aea0-429446b554ad None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:07.696805 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597a6e-9f43-49d8-aea0-429446b554ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:07.716565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e7597a6e-9f43-49d8-aea0-429446b554ad None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:07.717775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e7597a6e-9f43-49d8-aea0-429446b554ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:07.725859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1132/2285] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:07.741012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:07.752381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5273eb-c420-412e-bdc6-88beeb95a9bd service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:07.758423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:07.759004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:07.759281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:07.759550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:07.767666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:07.769270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:07.779638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1154/2286] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:11.929048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca55c9-d4fc-43b4-ae2f-ffad4128cc38 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:11.929607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca55c9-d4fc-43b4-ae2f-ffad4128cc38 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:11.929607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca55c9-d4fc-43b4-ae2f-ffad4128cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:11.951240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-54ca55c9-d4fc-43b4-ae2f-ffad4128cc38 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:11.952373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-54ca55c9-d4fc-43b4-ae2f-ffad4128cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:11.961123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1133/2287] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 30 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:11.978296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:11.989889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfb913-2d7d-4dcc-b890-a29d4a0bc962 service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:11.995407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:11.995984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:11.996257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:11.996524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:12.004441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:12.006699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb089-3e5a-49bd-8ded-bfdf12fc7a42 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:12.015826 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1155/2288] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:00:20.766055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aca44-c23e-44a4-b9be-5655fbadd7b2 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:20.766606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aca44-c23e-44a4-b9be-5655fbadd7b2 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:20.766606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aca44-c23e-44a4-b9be-5655fbadd7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:20.774737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=22 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:20.787072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-275aca44-c23e-44a4-b9be-5655fbadd7b2 None None] MFA Rules not processed for user `a5bf32548bcb4aea809e2561ba2b2f82`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:20.788271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-275aca44-c23e-44a4-b9be-5655fbadd7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:20.845792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1134/2289] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:22.011743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=49 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:30.844310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=24 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:39.272315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:39.272906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:39.273021 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:39.295313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] MFA Rules not processed for user `488eb88e27ed47e7856e999ef96efb69`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:39.296486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:39.354129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1156/2290] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:42.143980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:42.144419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:42.144626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:42.164449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] MFA Rules not processed for user `460f88282f7441648850c92bfa8a2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:42.165752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:42.173014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1135/2291] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:49.346096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=25 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:49.420983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:49.422427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:49.437323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ce37-7627-4a8b-9b4e-4850a8d9eb75 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:49.442708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:49.443366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:49.443642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:49.443911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] PATH_INFO: `/v3/users/48bc87302211411fb985ef7b1ccd511b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:49.445061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bc87302211411fb985ef7b1ccd511b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:49.447069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:49.590078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bc87302211411fb985ef7b1ccd511b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:49.603657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bc87302211411fb985ef7b1ccd511b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:49.611806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bc87302211411fb985ef7b1ccd511b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:49.612600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bc87302211411fb985ef7b1ccd511b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:49.613931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0b8aaea2-7d05-4a5c-ab61-c0a12334cf42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bc87302211411fb985ef7b1ccd511b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:49.689037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1157/2292] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:00:49 2022] DELETE /identity/v3/users/48bc87302211411fb985ef7b1ccd511b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:00:50.182134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:50.195010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b706652-6bb3-4d6d-a156-d856307690ec None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:50.254591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:50.255231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.255511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.255776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] PATH_INFO: `/v3/projects/8fbbcfe7f3af4297bc47ea0461a0b559` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.257049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbbcfe7f3af4297bc47ea0461a0b559)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:50.259032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:50.372562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbbcfe7f3af4297bc47ea0461a0b559', 'request_id': 'req-9068cedb-9285-4194-bcc9-2a76a8a9f236'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:50.380447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbbcfe7f3af4297bc47ea0461a0b559', 'request_id': 'req-9068cedb-9285-4194-bcc9-2a76a8a9f236'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:50.386756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbbcfe7f3af4297bc47ea0461a0b559', 'request_id': 'req-9068cedb-9285-4194-bcc9-2a76a8a9f236'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:50.448536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] The token cache is being invalidate because project 8fbbcfe7f3af4297bc47ea0461a0b559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:00:50.448870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:50.449552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9068cedb-9285-4194-bcc9-2a76a8a9f236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:00:50.451100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1136/2293] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:00:50 2022] DELETE /identity/v3/projects/8fbbcfe7f3af4297bc47ea0461a0b559 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:00:50.455900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.457535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.457535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.476408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:50.477640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:50.537146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1158/2294] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:50.544824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.545115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.549236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.568782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:50.569986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:50.581816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1137/2295] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:50.583724 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:50.594595 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843be6b-3d1d-47ba-92d8-714dd5aa36b8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:50.600183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:50.600822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.601096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.601366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.602011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:00:50.602309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:50.603908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:50.617829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1159/2296] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:00:50.622294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:50.632618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca785-a9e3-447a-b05b-23b63c732626 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:50.637523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:50.638127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.638406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.638678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.639322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:50.641287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:50.743147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1138/2297] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:00:50 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:00:50.747506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:50.759419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc293f-86a7-47a8-9adf-d06cf25cbf1a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:50.833570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:50.834183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.834462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.834739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.835452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:50.837346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:50.847779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:50.963284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1160/2298] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:00:50 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:00:50.968830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:50.980987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502a8a-d572-4084-81f5-651a5c7150ee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:50.986315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:50.986916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:50.987191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:50.987462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:50.988122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:50.989929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:51.000894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1139/2299] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:00:51.004896 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:51.015331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e8b6-9109-4f79-9a8b-e741fa1b033e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:51.020639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:51.021254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:51.021528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:51.021794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:51.022429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:51.024183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef7cec-581f-4757-89de-9351854db73d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:51.036195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1161/2300] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:00:51.040221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:51.050336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe3ed-d1c6-42cf-bf33-6e7c099b8a52 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:51.055386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:51.056038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:51.056319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:51.056589 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] PATH_INFO: `/v3/projects/e31fb4a9a2454cbca7514994aa362086/users/1790b44a10244376bd5a4b7217d9f3f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:51.072995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31fb4a9a2454cbca7514994aa362086, user_id=1790b44a10244376bd5a4b7217d9f3f1, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:51.075748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:51.159685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1140/2301] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:00:51 2022] PUT /identity/v3/projects/e31fb4a9a2454cbca7514994aa362086/users/1790b44a10244376bd5a4b7217d9f3f1/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:00:51.232304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:51.232584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:51.232884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:51.263771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] MFA Rules not processed for user `1790b44a10244376bd5a4b7217d9f3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:00:51.265074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:51.339076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1162/2302] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:00:51.351228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:00:51.353075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:00:51.377616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:51.423017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02f06-2f08-438a-83b8-72493f129523 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:00:51.429406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:00:51.430130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:00:51.430487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:00:51.430920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:00:51.448649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:00:51.450197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbf61-1763-4732-9094-d5fa88f02671 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:00:51.463890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1141/2303] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:01.439830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:01.684806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=17 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:03.499598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:03.561761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ae36-5ad5-4b77-99d9-1f87c637617b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:03.566378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:03.567037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:03.567315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:03.567587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] PATH_INFO: `/v3/users/1790b44a10244376bd5a4b7217d9f3f1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:03.568730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1790b44a10244376bd5a4b7217d9f3f1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:03.570754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:03.793662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1790b44a10244376bd5a4b7217d9f3f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:03.806166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1790b44a10244376bd5a4b7217d9f3f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:03.813001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1790b44a10244376bd5a4b7217d9f3f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:03.813715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1790b44a10244376bd5a4b7217d9f3f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:03.814331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1790b44a10244376bd5a4b7217d9f3f1'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:03.888202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1163/2304] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:03 2022] DELETE /identity/v3/users/1790b44a10244376bd5a4b7217d9f3f1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:03.892813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:03.893282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:03.893415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:03.912849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:03.914555 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:03.971338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1142/2305] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:03.981583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:03.982976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:04.041248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109c77f-1d6a-4a11-a3a4-63344ae1a248 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:04.044825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:04.045353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:04.045627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:04.045892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:04.054644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:04.056075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:04.065388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1164/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:04.453527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:04.456123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:04.470489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02409e-6581-4d02-b49c-cb290394bac1 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:04.480223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:04.480951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:04.481188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:04.481489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] PATH_INFO: `/v3/projects/e31fb4a9a2454cbca7514994aa362086` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:04.482674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31fb4a9a2454cbca7514994aa362086)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:04.484744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:04.617885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31fb4a9a2454cbca7514994aa362086', 'request_id': 'req-f08749fe-c0d6-4188-b439-b43929b66f1f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:04.624266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31fb4a9a2454cbca7514994aa362086', 'request_id': 'req-f08749fe-c0d6-4188-b439-b43929b66f1f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:04.630066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31fb4a9a2454cbca7514994aa362086', 'request_id': 'req-f08749fe-c0d6-4188-b439-b43929b66f1f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:04.702273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] The token cache is being invalidate because project e31fb4a9a2454cbca7514994aa362086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:04.702590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:04.703206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:04.704972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1143/2307] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:04 2022] DELETE /identity/v3/projects/e31fb4a9a2454cbca7514994aa362086 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:05.527171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:05.535588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796516a4-8d7f-49dd-8bcb-43d47af55995 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:05.553150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:05.582509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:05.583101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:05.583378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:05.583649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:05.585374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:05.656385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:05.657854 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:05.668703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1165/2308] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:07.136643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:07.138277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:07.151581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08749fe-c0d6-4188-b439-b43929b66f1f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:07.155313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:07.155908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:07.156187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:07.156462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:07.158227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:07.171352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:07.172826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:07.183892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1144/2309] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:12.985466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:12.986888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:12.997412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3ef7-72a8-4f59-99cc-200dc74f1e80 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:13.000998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:13.001571 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:13.001844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:13.002109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:13.003737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:13.067020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:13.068448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:13.078382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1166/2310] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:17.179219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:17.262976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:17.264459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:17.278902 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e98bb-6cb9-4dfb-a8ee-8d02bff5b19e service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:17.283676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:17.284316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:17.284600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:17.284909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] PATH_INFO: `/v3/users/bd2a46a3fc3c44779e324d28070fb17e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:17.286240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2a46a3fc3c44779e324d28070fb17e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:17.288215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:17.462395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2a46a3fc3c44779e324d28070fb17e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:17.463486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2a46a3fc3c44779e324d28070fb17e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:17.470879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2a46a3fc3c44779e324d28070fb17e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:17.536333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2a46a3fc3c44779e324d28070fb17e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:17.537012 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-d91173a6-b5f2-4a82-89bb-abc34ca65b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2a46a3fc3c44779e324d28070fb17e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:17.558990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1145/2311] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:17 2022] DELETE /identity/v3/users/bd2a46a3fc3c44779e324d28070fb17e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:17.814148 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:17.830519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75da0-49b0-4e01-a1e9-54ac0f42e265 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:17.891175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:17.897261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:17.897886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:17.898767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:17.899119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] PATH_INFO: `/v3/projects/93bcc00307f247c1ae99c0640b1f19d7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:17.900512 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bcc00307f247c1ae99c0640b1f19d7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:17.902485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.034386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bcc00307f247c1ae99c0640b1f19d7', 'request_id': 'req-0380f62f-d202-4479-8f4f-669b99bcf26b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:18.040937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bcc00307f247c1ae99c0640b1f19d7', 'request_id': 'req-0380f62f-d202-4479-8f4f-669b99bcf26b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:18.047349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bcc00307f247c1ae99c0640b1f19d7', 'request_id': 'req-0380f62f-d202-4479-8f4f-669b99bcf26b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:18.119670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] The token cache is being invalidate because project 93bcc00307f247c1ae99c0640b1f19d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:18.119956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:18.120572 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0380f62f-d202-4479-8f4f-669b99bcf26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:18.122251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1167/2312] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:17 2022] DELETE /identity/v3/projects/93bcc00307f247c1ae99c0640b1f19d7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:18.128183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.128497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.128826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.151628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:18.152857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:18.229394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1146/2313] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:18.237104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.237382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.237647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.258075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:18.259361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:18.267351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1168/2314] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:18.271643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.282892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9ab9f-3f7f-492d-bcf5-9b6ed654a9d8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.287612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.288220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.288499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.288962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.289702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:18.290015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.291622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.303149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1147/2315] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:18.307417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.316809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155cb4c-d8e7-4e71-827d-a2e12fca02f8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.322303 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.327367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.327367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.327367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.327367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.327367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.407804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1169/2316] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:18.417750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.428879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f6759-c7ed-4f6e-9bfb-30f169da6922 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.494357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.494956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.495236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.495508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.496133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.498084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.505964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:18.596724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1148/2317] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:18.600734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.611657 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8dde-5239-4766-9f77-bf21d0947149 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.616167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.625726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.626096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.626395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.627037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.628635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.639041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1170/2318] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:18.643063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.654718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0a18-0e8c-474c-bbe8-880659b82c25 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.659948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.660538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.660859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.661132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.661772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.663375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16438b-3898-40a7-b9c8-2e31fda23802 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.675105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1149/2319] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:18.679047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.689123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f83c6-505f-4222-91b3-e49fe08f5c4b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:18.693766 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:18.694393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.694668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.694969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] PATH_INFO: `/v3/projects/7e589f42bacf4eb79a24ee38298e4a7c/users/05affa8229cf406db191850e0ed7b9b3/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.709381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e589f42bacf4eb79a24ee38298e4a7c, user_id=05affa8229cf406db191850e0ed7b9b3, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:18.712697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:18.816375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1171/2320] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:18 2022] PUT /identity/v3/projects/7e589f42bacf4eb79a24ee38298e4a7c/users/05affa8229cf406db191850e0ed7b9b3/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:18.827623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:18.827908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:18.828183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:18.859594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] MFA Rules not processed for user `05affa8229cf406db191850e0ed7b9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:18.860835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:18.927281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1150/2321] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:18.932128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:18.999247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e37b-aa9c-4b8c-b1a7-088968b597cd admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.003920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.004511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.004889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.005163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.005798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.008242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.111963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1172/2322] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:18 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:19.115866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.126943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe53307-8a0e-4959-b946-4a2372bdf08a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.187613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.187613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.187613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.187613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.188126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.189018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.266128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1151/2323] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:19 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:19.270091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.280898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d1fe-ed29-4da0-ab21-aa0593d05a6d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.285492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.286120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.286427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.286665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.287298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.289020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.291083 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:19.299778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1173/2324] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:19.303868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.314789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f051-0253-47d8-9cc4-c3f9d24fafa2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.319769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.321177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.321537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.321811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] PATH_INFO: `/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b/users/b6371ea730504318ba39311ac9ea05a7/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.338286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a80bb03dc43e2b012f76b3c564c0b, user_id=b6371ea730504318ba39311ac9ea05a7, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.341183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.439127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1152/2325] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:19 2022] PUT /identity/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b/users/b6371ea730504318ba39311ac9ea05a7/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:19.443216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.453686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c54b1a-0d72-4256-9727-c3402e91859c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.511118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.511716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.511996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.512264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.512920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.514565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b16079-032d-4d9d-a830-53e196c48b3c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.525179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1174/2326] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:19.529756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.540581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a362f-172e-4ace-9d09-c4577bb2cd1e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.545230 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.545873 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.546152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.546425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] PATH_INFO: `/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b/users/b6371ea730504318ba39311ac9ea05a7/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.548311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a80bb03dc43e2b012f76b3c564c0b, user_id=b6371ea730504318ba39311ac9ea05a7, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.551037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.561348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1153/2327] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:19 2022] PUT /identity/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b/users/b6371ea730504318ba39311ac9ea05a7/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:19.573628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.573912 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.574184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.601867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] MFA Rules not processed for user `b6371ea730504318ba39311ac9ea05a7`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:19.603073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:19.680425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1175/2328] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:19.692306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:19.694073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:19.717184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:19.753904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1e64-3a05-42bf-9c8d-9d0f2802288a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:19.757660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:19.758263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:19.758541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:19.758817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:19.768108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:19.769583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b8e4c-ed4e-453c-a8e0-17d19633841a service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:19.781291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1154/2329] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:20.667961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:20.748473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904ee8-2180-47b9-a3ed-f39c3707bbdf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:20.754298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:20.754968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:20.755241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:20.755508 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] PATH_INFO: `/v3/users/05affa8229cf406db191850e0ed7b9b3` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:20.756717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05affa8229cf406db191850e0ed7b9b3)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:20.759205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:20.788074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:20.990872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05affa8229cf406db191850e0ed7b9b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.003911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05affa8229cf406db191850e0ed7b9b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.011647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05affa8229cf406db191850e0ed7b9b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.012415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05affa8229cf406db191850e0ed7b9b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.013050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05affa8229cf406db191850e0ed7b9b3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.105973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1176/2330] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:20 2022] DELETE /identity/v3/users/05affa8229cf406db191850e0ed7b9b3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:21.114722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:21.115248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:21.115346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:21.135023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:21.136235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:21.199023 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1155/2331] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:21.209824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:21.211942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:21.275617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573eae9-5dd2-4525-b4f8-38af4ad6240e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:21.279356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:21.279998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:21.280279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:21.280581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:21.290851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:21.292299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:21.302664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1177/2332] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:21.686500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:21.690416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:21.699983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb5ca-8df3-4991-b30e-b5d7eeaa38e4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:21.705227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:21.705910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:21.706189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:21.706457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] PATH_INFO: `/v3/projects/7e589f42bacf4eb79a24ee38298e4a7c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:21.707623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e589f42bacf4eb79a24ee38298e4a7c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:21.709619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:21.816785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e589f42bacf4eb79a24ee38298e4a7c', 'request_id': 'req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.823640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e589f42bacf4eb79a24ee38298e4a7c', 'request_id': 'req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.829205 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e589f42bacf4eb79a24ee38298e4a7c', 'request_id': 'req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.883410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] The token cache is being invalidate because project 7e589f42bacf4eb79a24ee38298e4a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:21.883699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.884325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:21.886058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1156/2333] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:21 2022] DELETE /identity/v3/projects/7e589f42bacf4eb79a24ee38298e4a7c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:21.890217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:21.900111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0269f-cee2-47bd-937d-11d249376faa service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:21.955559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:21.956167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:21.956438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:21.956729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] PATH_INFO: `/v3/users/b6371ea730504318ba39311ac9ea05a7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:21.957829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6371ea730504318ba39311ac9ea05a7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:21.959719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:22.136023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:22.138598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6371ea730504318ba39311ac9ea05a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.151035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6371ea730504318ba39311ac9ea05a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.157844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6371ea730504318ba39311ac9ea05a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.158685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6371ea730504318ba39311ac9ea05a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.164976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-48b2e694-4cda-48d0-8bf3-fcbd642094a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6371ea730504318ba39311ac9ea05a7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.236975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1178/2334] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:21 2022] DELETE /identity/v3/users/b6371ea730504318ba39311ac9ea05a7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:22.741212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:22.743705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:22.762079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb62e-a59a-4d23-a85e-5c5afc9148d6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:22.814762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:22.827310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:22.827939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:22.828215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:22.828487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] PATH_INFO: `/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:22.829644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97a80bb03dc43e2b012f76b3c564c0b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:22.831562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:22.927864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97a80bb03dc43e2b012f76b3c564c0b', 'request_id': 'req-3586257a-589a-46c7-8213-b319e83a894e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.934656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97a80bb03dc43e2b012f76b3c564c0b', 'request_id': 'req-3586257a-589a-46c7-8213-b319e83a894e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:22.940432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97a80bb03dc43e2b012f76b3c564c0b', 'request_id': 'req-3586257a-589a-46c7-8213-b319e83a894e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:23.038443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] The token cache is being invalidate because project e97a80bb03dc43e2b012f76b3c564c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:23.039279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:23.039918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3586257a-589a-46c7-8213-b319e83a894e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:23.041472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1157/2335] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:22 2022] DELETE /identity/v3/projects/e97a80bb03dc43e2b012f76b3c564c0b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:23.046456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.046968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.047070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.066498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:23.067842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:23.129355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1179/2336] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:23.137244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.137533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.137804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.158427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:23.162633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:23.167854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1158/2337] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:23.172173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.185546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c236b8-8072-4214-853b-7c60e4b920a7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.187391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.187991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.188269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.188546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.189220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:23.189523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.191155 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.203631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1180/2338] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:23.208203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.217533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d989854-b398-46d5-819c-bae1f61dad5e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.222169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.222758 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.223039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.223304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.223939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.226002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.320854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1159/2339] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:23.324991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.335124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858d9d8-1bf1-416d-8464-66108dd8c2de admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.392781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.393390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.393669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.393942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.394570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.396550 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.490478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1181/2340] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:23.495358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.505994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129b844-c2ac-4021-8408-b63ae7f80d58 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.510850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.511584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.511849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.512121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.512828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.514452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.524600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1160/2341] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:23.531114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.541722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136285b2-0513-4b57-b491-26007c7cb13e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.546682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.547262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.547542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.547809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.548449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.550114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374641e6-e995-4c47-9cdb-f54def40b411 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.561558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1182/2342] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:23.565694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.575888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552be5-fda4-4a5f-b582-1a96926b82be admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.580675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.581331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.581614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.581891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] PATH_INFO: `/v3/projects/a5ae3e5a94c44978a2cdf5148c1f86d9/users/a585a351a1f34091bb457723aa4376ee/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.598707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ae3e5a94c44978a2cdf5148c1f86d9, user_id=a585a351a1f34091bb457723aa4376ee, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.602223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.674398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1161/2343] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:23 2022] PUT /identity/v3/projects/a5ae3e5a94c44978a2cdf5148c1f86d9/users/a585a351a1f34091bb457723aa4376ee/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:23.686478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.686759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.687150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.731365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] MFA Rules not processed for user `a585a351a1f34091bb457723aa4376ee`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:23.733112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:23.760630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:23.818202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1183/2344] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:23.822769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.915946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d534-4256-42f0-b506-cb3e0d8a28b1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:23.921336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:23.922008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:23.922353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:23.922690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:23.924485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:23.925441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:23.953348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:23.957714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.005014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:24.013452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1162/2345] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:23 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:24.016535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf584e-2147-4877-8669-475b02f382e2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.017429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.065208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.065813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.066074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.066363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.068077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.078350 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.081643 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.081767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c781-78c5-43cd-95de-f8049256bb30 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.086949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.087468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.087746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.087935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1184/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:24.088331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.089000 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.091188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.173811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1163/2347] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:24 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:24.177821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.189196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e17d-9b88-4d0c-897e-f699bc836622 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.213000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.213627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.213906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.214176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.215377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.217237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.229503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1185/2348] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:24.233774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.244160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fce53-464a-4406-87e4-3f0767d4b156 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.249278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.249934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.250215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.250522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] PATH_INFO: `/v3/projects/72267a8d378342d797c24f0ed4c2d06a/users/e3ad35a1e8894ebcad7677d08c64c9d5/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.266646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72267a8d378342d797c24f0ed4c2d06a, user_id=e3ad35a1e8894ebcad7677d08c64c9d5, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.269288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.372466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1164/2349] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:24 2022] PUT /identity/v3/projects/72267a8d378342d797c24f0ed4c2d06a/users/e3ad35a1e8894ebcad7677d08c64c9d5/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:24.377044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.388118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d028-6cc3-43a6-b42d-534b2a5a8cc6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.468540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.469173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.469448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.469713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.470347 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.471929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b7354-9b03-4112-8a06-8ffd8b7f3e4f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.478706 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:24.483828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1186/2350] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:24.487999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.499268 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337737-67f1-4a0d-b32e-cbdee9e7b56d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.504875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.505536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.505830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.506085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] PATH_INFO: `/v3/projects/72267a8d378342d797c24f0ed4c2d06a/users/e3ad35a1e8894ebcad7677d08c64c9d5/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.508956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72267a8d378342d797c24f0ed4c2d06a, user_id=e3ad35a1e8894ebcad7677d08c64c9d5, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.511987 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.539428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1165/2351] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:24 2022] PUT /identity/v3/projects/72267a8d378342d797c24f0ed4c2d06a/users/e3ad35a1e8894ebcad7677d08c64c9d5/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:24.539849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.539849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.539849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.579964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] MFA Rules not processed for user `e3ad35a1e8894ebcad7677d08c64c9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:24.581220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.654537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1187/2352] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:24.665552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.667283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.672400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.673755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.728629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095027-b87a-4062-8cd6-47676f1b9578 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.732452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.733083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.733364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.733629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.743100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.744540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.747856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135f8e-b538-4a8b-91b4-5e6d3d8cca33 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.753074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.753677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.754004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1166/2353] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:24.754127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.754276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.756133 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.768482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.770032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.783297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1188/2354] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:24.813264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:24.814672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:24.827103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228218c-7a90-4a0e-a718-ee07c49ffb67 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:24.831428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:24.832399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:24.832701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:24.833250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:24.892950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:24.920374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:24.920374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:24.920374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1167/2355] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:28.334971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:28.337129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:28.410033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913892c5-4cc8-4af4-96d7-b0527ed9e890 service placement] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:28.415649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:28.416241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:28.416519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:28.417435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:28.418558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:28.428772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:28.479517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:28.481908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da6002-8478-4e8a-b3f6-df6797fe18c5 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:28.491269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1189/2356] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:29.641803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:29.707070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872d40-e3df-42f1-882c-2ca44b2977bd service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:29.712474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:29.713141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:29.713422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:29.713716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] PATH_INFO: `/v3/users/a585a351a1f34091bb457723aa4376ee` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:29.714861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a585a351a1f34091bb457723aa4376ee)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:29.716845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:29.868183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a585a351a1f34091bb457723aa4376ee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:29.868865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a585a351a1f34091bb457723aa4376ee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:29.875772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a585a351a1f34091bb457723aa4376ee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:29.970381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a585a351a1f34091bb457723aa4376ee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:29.971018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a585a351a1f34091bb457723aa4376ee'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:29.989018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1168/2357] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:29 2022] DELETE /identity/v3/users/a585a351a1f34091bb457723aa4376ee => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:29.994251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:29.994743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:29.994847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:30.014290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:30.015493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:30.073499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1190/2358] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:30.083111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:30.084518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:30.153711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501231-1c1f-4a58-9a9c-de21c4180d15 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:30.158703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:30.159315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:30.159601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:30.159881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:30.169816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:30.171282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:30.181411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1169/2359] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:30.703622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:30.705110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:30.719375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631263ec-bdee-4ef5-b214-ad26256e45a4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:30.724250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:30.724895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:30.725170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:30.725953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] PATH_INFO: `/v3/projects/a5ae3e5a94c44978a2cdf5148c1f86d9` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:30.727815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ae3e5a94c44978a2cdf5148c1f86d9)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:30.729832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:30.852469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ae3e5a94c44978a2cdf5148c1f86d9', 'request_id': 'req-0e31cbc0-941c-4ded-894f-9f2d6e9347df'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:30.859082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ae3e5a94c44978a2cdf5148c1f86d9', 'request_id': 'req-0e31cbc0-941c-4ded-894f-9f2d6e9347df'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:30.865725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ae3e5a94c44978a2cdf5148c1f86d9', 'request_id': 'req-0e31cbc0-941c-4ded-894f-9f2d6e9347df'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:30.957553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] The token cache is being invalidate because project a5ae3e5a94c44978a2cdf5148c1f86d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:30.957839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:30.958473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:30.959951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1191/2360] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:30 2022] DELETE /identity/v3/projects/a5ae3e5a94c44978a2cdf5148c1f86d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:30.964212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:30.974472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269468e8-28c7-4d55-bf3e-1584c7ab6f7d service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:30.988478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:31.046492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:31.047153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:31.047436 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:31.047713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] PATH_INFO: `/v3/users/e3ad35a1e8894ebcad7677d08c64c9d5` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:31.048881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ad35a1e8894ebcad7677d08c64c9d5)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:31.050817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:31.238853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ad35a1e8894ebcad7677d08c64c9d5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.239507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ad35a1e8894ebcad7677d08c64c9d5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.246913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ad35a1e8894ebcad7677d08c64c9d5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.333479 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ad35a1e8894ebcad7677d08c64c9d5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.334084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-19347836-52c9-4169-ac1d-d63b21e6938b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ad35a1e8894ebcad7677d08c64c9d5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.352240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1170/2361] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:30 2022] DELETE /identity/v3/users/e3ad35a1e8894ebcad7677d08c64c9d5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:31.758795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:31.761233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:31.780642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cbc0-941c-4ded-894f-9f2d6e9347df admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:31.817527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:31.842330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:31.842953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:31.843299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:31.843509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] PATH_INFO: `/v3/projects/72267a8d378342d797c24f0ed4c2d06a` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:31.844631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] RBAC: Authorizing `identity:delete_project(project_id=72267a8d378342d797c24f0ed4c2d06a)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:31.846634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:31.952584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72267a8d378342d797c24f0ed4c2d06a', 'request_id': 'req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.958652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72267a8d378342d797c24f0ed4c2d06a', 'request_id': 'req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:31.964629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72267a8d378342d797c24f0ed4c2d06a', 'request_id': 'req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:32.077742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] The token cache is being invalidate because project 72267a8d378342d797c24f0ed4c2d06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:32.078030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:32.078654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ee1c2e15-2e33-47ee-8a0c-8e98f3dadfea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:32.080210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1192/2362] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:31 2022] DELETE /identity/v3/projects/72267a8d378342d797c24f0ed4c2d06a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:32.085056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.085522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.085789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.106526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:32.107726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.171628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1171/2363] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:32.179984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.180259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.180532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.201838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:32.203006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.210906 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1193/2364] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:32.215078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.224606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e8fb-3c28-4b8e-a978-7ee1cd33fa99 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.229322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.229908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.230186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.230453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.231094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:32.231392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.233761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.246358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1172/2365] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:32.250690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.260802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf6c37-63d2-4c57-815d-6371e6c4bc3d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.265440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.266054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.266330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.266601 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.267320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.269353 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.360710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1194/2366] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:32.365088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.375672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa282c4-6133-40b7-bb77-42e6ca5cca9e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.394199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:32.434965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.435562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.435839 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.436108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.436770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.438742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.530455 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.532158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.576640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1173/2367] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:32.580694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.591273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df497-c418-4a17-8bca-5c7e812159b6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.596016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.596608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.597144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.597296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.597825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.599420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.608175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1ee0-953c-474c-984a-4a428a4c2e6e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.609548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1174/2368] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:32.618782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.618939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.618939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.618939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.618939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.620311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.622745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22799f4e-ba38-49c7-99ff-144ed289cc5d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.627412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.627995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.628275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.628549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.629209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.630800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.642198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1175/2369] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:32.647498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.657077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57eab-65b7-4377-9a9a-6f3737170721 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.657218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:32.662024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.662673 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.662953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.663228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] PATH_INFO: `/v3/projects/0c1df7741d884cf99f3ce8efb5976e1b/users/b12c717ce80b4502b915e1ba9f2a1328/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.677700 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1df7741d884cf99f3ce8efb5976e1b, user_id=b12c717ce80b4502b915e1ba9f2a1328, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.680345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.682596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.684210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c757e-6fc3-48e5-a041-5f2e8b16efb7 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:32.693799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1195/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:32.753416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1176/2371] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:32 2022] PUT /identity/v3/projects/0c1df7741d884cf99f3ce8efb5976e1b/users/b12c717ce80b4502b915e1ba9f2a1328/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:32.765926 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.771860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.771860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.801996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] MFA Rules not processed for user `b12c717ce80b4502b915e1ba9f2a1328`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:32.803393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:32.891115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1196/2372] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:32.896209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:32.971503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af769-7ce8-4a5f-9d56-c76ba67f9389 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:32.976326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:32.977094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:32.977371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:32.977674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:32.978298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:32.980182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.052278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1177/2373] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:32 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:33.057149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.068087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf9c7-6a1e-457c-a104-e8a494265fed None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.128351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.226819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1197/2374] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:33 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:33.238094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.249442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37869-f1d5-4f0f-aaae-b8bf8eeeeb23 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.254794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.255397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.256315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.259140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.259140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.259635 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.272686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1178/2375] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:33.276363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.287205 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f30cd-c78d-4d6e-a175-3a0ed21fb17a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.293443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.294412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.294737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.294927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] PATH_INFO: `/v3/projects/4b5dd5819a034ecb8e7943d7a8953566/users/57bdd57b0e1648cabec9b1acae865c0a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.321902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5dd5819a034ecb8e7943d7a8953566, user_id=57bdd57b0e1648cabec9b1acae865c0a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.329434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.352641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.354508 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:33.402337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:33.419796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1198/2376] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:33 2022] PUT /identity/v3/projects/4b5dd5819a034ecb8e7943d7a8953566/users/57bdd57b0e1648cabec9b1acae865c0a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:33.420617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45782326-3635-4bb9-a67f-8b7047957b1b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.424932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.460151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:33.480184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.480923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.481273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.481621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.483482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:33.493750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.495298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.495867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63df0db-9f07-40e1-b11c-456f1df8b86e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.506686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.506686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.506686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.506686 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.507097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.507215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1179/2377] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:33.507345 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50a8b8-dcbc-40bf-be37-8f91474ada79 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.517879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1199/2378] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:33.519347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.531506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba440ee1-5d35-4fff-9585-6e9d7c1206f0 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.536204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.536898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.537183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.537459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] PATH_INFO: `/v3/projects/4b5dd5819a034ecb8e7943d7a8953566/users/57bdd57b0e1648cabec9b1acae865c0a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.539653 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5dd5819a034ecb8e7943d7a8953566, user_id=57bdd57b0e1648cabec9b1acae865c0a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.542347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.553259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1180/2379] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:33 2022] PUT /identity/v3/projects/4b5dd5819a034ecb8e7943d7a8953566/users/57bdd57b0e1648cabec9b1acae865c0a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:33.564824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.565113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.565390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.602585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] MFA Rules not processed for user `57bdd57b0e1648cabec9b1acae865c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:33.603809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:33.671972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1200/2380] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:33.683986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.685850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:33.743444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cf58b-280b-4795-92f0-9fc73cfd7f09 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.747503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.748112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.748430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.748733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.758415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.759908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.769946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1181/2381] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:33.882040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:33.891913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d25c6-005b-4420-815c-c5530a540ccf None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:33.896882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:33.896882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:33.896882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:33.896882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:33.957631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:33.959015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ebd34-f211-4a87-8787-ac1b59e3d7e1 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:33.968305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1201/2382] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:37.217550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:37.282821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad52e-8056-4179-aeed-b800d5a1a7c8 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:37.287349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:37.287998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:37.288336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:37.289186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] PATH_INFO: `/v3/users/b12c717ce80b4502b915e1ba9f2a1328` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:37.293875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12c717ce80b4502b915e1ba9f2a1328)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:37.293875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:37.375001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:37.503667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12c717ce80b4502b915e1ba9f2a1328'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:37.504372 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12c717ce80b4502b915e1ba9f2a1328'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:37.511790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12c717ce80b4502b915e1ba9f2a1328'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:37.598489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12c717ce80b4502b915e1ba9f2a1328'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:37.599194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12c717ce80b4502b915e1ba9f2a1328'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:37.617267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1182/2383] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:37 2022] DELETE /identity/v3/users/b12c717ce80b4502b915e1ba9f2a1328 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:37.622249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:37.622764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:37.622878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:37.642002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:37.643182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:37.689520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:37.705388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1202/2384] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:37.716126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:37.717912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:37.780213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85fb9d-cdfa-40fe-a922-f578470b6efc admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:37.784453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:37.785239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:37.785630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:37.785936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:37.796342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:37.797850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:37.809077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1183/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:38.286823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:38.292877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:38.325357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b93d3-8a9b-44be-b13c-6cc35bde567e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:38.331388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:38.332066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:38.332468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:38.332993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] PATH_INFO: `/v3/projects/0c1df7741d884cf99f3ce8efb5976e1b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:38.334269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1df7741d884cf99f3ce8efb5976e1b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:38.336723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:38.439472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1df7741d884cf99f3ce8efb5976e1b', 'request_id': 'req-b14431ee-7daf-47e0-865d-345a699076a3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.446242 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1df7741d884cf99f3ce8efb5976e1b', 'request_id': 'req-b14431ee-7daf-47e0-865d-345a699076a3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.452172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1df7741d884cf99f3ce8efb5976e1b', 'request_id': 'req-b14431ee-7daf-47e0-865d-345a699076a3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.524313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] The token cache is being invalidate because project 0c1df7741d884cf99f3ce8efb5976e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:38.524611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.525519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.526985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1203/2386] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:38 2022] DELETE /identity/v3/projects/0c1df7741d884cf99f3ce8efb5976e1b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:38.531170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:38.541140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6c0c-abac-4b45-8d99-d238fb9288ba service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:38.599667 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:38.600208 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:38.600488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:38.600816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] PATH_INFO: `/v3/users/57bdd57b0e1648cabec9b1acae865c0a` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:38.602774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bdd57b0e1648cabec9b1acae865c0a)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:38.604556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:38.794027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bdd57b0e1648cabec9b1acae865c0a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.794675 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bdd57b0e1648cabec9b1acae865c0a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.796794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:38.802146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bdd57b0e1648cabec9b1acae865c0a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.893517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bdd57b0e1648cabec9b1acae865c0a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.894141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ab33ee73-616f-4f73-b585-ece6c357cf40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bdd57b0e1648cabec9b1acae865c0a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:38.922429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1184/2387] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:38 2022] DELETE /identity/v3/users/57bdd57b0e1648cabec9b1acae865c0a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:39.405191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:39.406736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:39.423214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14431ee-7daf-47e0-865d-345a699076a3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:39.492717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:39.493337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.493610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.493877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] PATH_INFO: `/v3/projects/4b5dd5819a034ecb8e7943d7a8953566` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.494988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5dd5819a034ecb8e7943d7a8953566)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:39.496943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:39.620902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5dd5819a034ecb8e7943d7a8953566', 'request_id': 'req-78e21618-4e7c-431d-a136-d0a5975b807e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:39.627180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5dd5819a034ecb8e7943d7a8953566', 'request_id': 'req-78e21618-4e7c-431d-a136-d0a5975b807e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:39.633948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5dd5819a034ecb8e7943d7a8953566', 'request_id': 'req-78e21618-4e7c-431d-a136-d0a5975b807e'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:39.706952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] The token cache is being invalidate because project 4b5dd5819a034ecb8e7943d7a8953566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:39.707354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:39.708278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-78e21618-4e7c-431d-a136-d0a5975b807e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:39.709903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1204/2388] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:39 2022] DELETE /identity/v3/projects/4b5dd5819a034ecb8e7943d7a8953566 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:39.715006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.715521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.715619 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.735522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:39.736762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:39.797762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1185/2389] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:39.806846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.807126 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.807511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.815631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:39.829558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:39.832237 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:39.838817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1205/2390] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:39.843107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:39.854082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa3f7-207d-4b21-a40c-b6b6c3181d0a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:39.859025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:39.860392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.860701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.860976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.861633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:39.861934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:39.863810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:39.877060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1186/2391] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:39.881490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:39.890781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff864bb9-baea-4b4b-aa29-dc2052542f34 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:39.895410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:39.895994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:39.896268 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:39.896537 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:39.897202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:39.899366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:39.998802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1206/2392] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:39 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:40.002395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.013224 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e418fea-cd0d-4bfb-b382-8f6355378707 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.071605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.072204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.072514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.072818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.073469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.075381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.158971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1187/2393] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:40 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:40.162844 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.173521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e66e-5e93-47be-8ac6-cc7d0dfd4422 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.178151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.178739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.179110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.179380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.180020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.181642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.195125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1207/2394] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:40.199149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.210020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73a8b-7571-40f5-8518-a0ee3069831e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.215746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.216360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.216639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.216940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.217595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.219215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7f365-cf5d-45fe-bc54-9b44b4d56501 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.230813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1188/2395] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:40.235033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.246640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28190c2-804d-434c-b25d-94b0332a5d2c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.251288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.251930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.252208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.252480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] PATH_INFO: `/v3/projects/e20bd82343e349c68480e659047583c0/users/65f6da3e483e4c479ba1bd980c2ad47b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.268324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20bd82343e349c68480e659047583c0, user_id=65f6da3e483e4c479ba1bd980c2ad47b, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.271063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.354202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1208/2396] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:40 2022] PUT /identity/v3/projects/e20bd82343e349c68480e659047583c0/users/65f6da3e483e4c479ba1bd980c2ad47b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:40.364576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.364876 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.365142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.396750 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] MFA Rules not processed for user `65f6da3e483e4c479ba1bd980c2ad47b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:40.398040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:40.422271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:40.485253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1189/2397] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:40.489917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.560575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51419a2-257d-456a-a524-805dd806ba5c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.568325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.568993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.569258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.569565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.570944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.573055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.721138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1209/2398] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:40 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:40.724399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.737646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd7c0-5ef3-4a1c-8d20-c3cf31ae6ce8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.798663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.799274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.799550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.799821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.800526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.802511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.915780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1190/2399] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:40 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:40.917009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.934988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3112-36b9-4dd2-995a-3cb92b9e6c91 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.943189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.943189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.943189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.943189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:40.943663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:40.943882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:40.959784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1210/2400] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:40.961971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:40.979033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d395-ad90-4b78-ade3-fa8aa8f907a1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:40.984486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:40.985267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:40.985540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:40.985816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] PATH_INFO: `/v3/projects/fa072d582f424c69ab318b3e04893923/users/be11f05694824e4c89bafec773711674/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.004338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa072d582f424c69ab318b3e04893923, user_id=be11f05694824e4c89bafec773711674, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.007698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.075730 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1191/2401] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:40 2022] PUT /identity/v3/projects/fa072d582f424c69ab318b3e04893923/users/be11f05694824e4c89bafec773711674/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:41.079736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.094232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3568b4-45af-4a4f-8962-4a8a44bba193 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.159966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.160569 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.160871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.161141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.161775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.163503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f4d4d-b5f7-4ce6-8576-94b71664d903 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.174567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1211/2402] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:41.178822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.189811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b1f9-451d-43bf-97ec-339f10808118 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.194446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.195704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.195981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.196257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] PATH_INFO: `/v3/projects/fa072d582f424c69ab318b3e04893923/users/be11f05694824e4c89bafec773711674/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.198337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa072d582f424c69ab318b3e04893923, user_id=be11f05694824e4c89bafec773711674, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.201143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.213093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1192/2403] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:41 2022] PUT /identity/v3/projects/fa072d582f424c69ab318b3e04893923/users/be11f05694824e4c89bafec773711674/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:41.226690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.227105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.227415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.250380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:41.260153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] MFA Rules not processed for user `be11f05694824e4c89bafec773711674`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:41.261481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:41.333795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1212/2404] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:41.346543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.349438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:41.428391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102784ef-9bf9-4d33-9581-ee228230bc6d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.433287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.433907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.434200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.434475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.447195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.449057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa477-28d4-4aa7-8cd7-bbccb97ce568 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.465383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1193/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:41.606025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:41.668146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a00f5-9445-4b5b-92d2-379cb15a7e5b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:41.672822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:41.673438 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.673710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.673978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] PATH_INFO: `/v3/users/65f6da3e483e4c479ba1bd980c2ad47b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.675105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f6da3e483e4c479ba1bd980c2ad47b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:41.677186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:41.869794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f6da3e483e4c479ba1bd980c2ad47b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.882517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f6da3e483e4c479ba1bd980c2ad47b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.889717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f6da3e483e4c479ba1bd980c2ad47b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.890450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f6da3e483e4c479ba1bd980c2ad47b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.891062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f6da3e483e4c479ba1bd980c2ad47b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:41.947264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1213/2406] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:41 2022] DELETE /identity/v3/users/65f6da3e483e4c479ba1bd980c2ad47b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:41.951813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:41.952329 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:41.952441 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:41.973188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:41.974384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:41.987641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:42.035731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1194/2407] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:42.045652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.047102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:42.063402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:42.106977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fba4-cde1-42d7-bd7c-462b5a830fa2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.110632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.111221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.111497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.111771 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.121335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.123583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.133436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1214/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:42.543483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.545075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:42.565333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b4a63-fcce-4a9e-96e4-df4b23f4b64f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.571525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.573059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.573742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.574412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] PATH_INFO: `/v3/projects/e20bd82343e349c68480e659047583c0` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.576711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20bd82343e349c68480e659047583c0)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.578833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:42.686852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20bd82343e349c68480e659047583c0', 'request_id': 'req-911cd245-b044-4d8e-a320-322cc2ffebe7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:42.693301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20bd82343e349c68480e659047583c0', 'request_id': 'req-911cd245-b044-4d8e-a320-322cc2ffebe7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:42.700597 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20bd82343e349c68480e659047583c0', 'request_id': 'req-911cd245-b044-4d8e-a320-322cc2ffebe7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:42.758296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] The token cache is being invalidate because project e20bd82343e349c68480e659047583c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:42.758703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:42.759341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:42.760865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1195/2409] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:42 2022] DELETE /identity/v3/projects/e20bd82343e349c68480e659047583c0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:42.764764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:42.775400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50895f88-05c9-4172-9b41-9db44c2a98ba service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:42.837907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:42.838519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:42.838793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:42.839060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] PATH_INFO: `/v3/users/be11f05694824e4c89bafec773711674` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:42.840193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be11f05694824e4c89bafec773711674)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:42.842119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:43.077472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be11f05694824e4c89bafec773711674'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.093291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be11f05694824e4c89bafec773711674'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.108474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be11f05694824e4c89bafec773711674'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.109436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be11f05694824e4c89bafec773711674'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.110191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3edaae18-26a4-4cc4-8541-4dbca305ce1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be11f05694824e4c89bafec773711674'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.221430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1215/2410] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:42 2022] DELETE /identity/v3/users/be11f05694824e4c89bafec773711674 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:43.614958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:43.616411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:43.631411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd245-b044-4d8e-a320-322cc2ffebe7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:43.689717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:43.690267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:43.690544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:43.690810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] PATH_INFO: `/v3/projects/fa072d582f424c69ab318b3e04893923` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:43.692037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa072d582f424c69ab318b3e04893923)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:43.693967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:43.826227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:43.830060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa072d582f424c69ab318b3e04893923', 'request_id': 'req-884919a8-5179-498a-a129-0c60d7e917b1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.837331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa072d582f424c69ab318b3e04893923', 'request_id': 'req-884919a8-5179-498a-a129-0c60d7e917b1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.842974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa072d582f424c69ab318b3e04893923', 'request_id': 'req-884919a8-5179-498a-a129-0c60d7e917b1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.922199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] The token cache is being invalidate because project fa072d582f424c69ab318b3e04893923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:43.922489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.923193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-884919a8-5179-498a-a129-0c60d7e917b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:43.924842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1196/2411] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:43 2022] DELETE /identity/v3/projects/fa072d582f424c69ab318b3e04893923 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:43.933252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:43.933252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:43.933252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:43.952897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:43.954032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:43.986296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:44.018337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1216/2412] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:44.028123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.028414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.028719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.051485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:44.052728 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:44.061917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1197/2413] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:44.066519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.076979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22857-01a3-4b40-b84e-54fb8cd446db None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.081940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.082545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.082823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.083096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.083753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:44.084058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.085711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.103794 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1217/2414] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:44.103905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.112756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd3db-0d09-46d2-bb41-2f00b504c710 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.118120 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.118731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.119020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.119288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.119936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.121928 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.225618 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1198/2415] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:44.230050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.243618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf87d-1fe9-417b-9f2a-2d23b463c035 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.329587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.330489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.330913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.331358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.332145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.334389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.468444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1218/2416] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:44.469585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.486572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0189-f053-4c3c-9478-c3c9beec56c8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.495695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.496536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.497639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.498040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.499773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.502672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.533771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1199/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:44.543276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.554030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949313ea-8842-4ea2-b7ec-23189941f88b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.559725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.560317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.560592 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.560892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.561543 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.563204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca0100-1adf-47b3-9aee-814041bfdcca admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.574352 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1219/2418] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:44.578788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.589211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9cb1a-97e4-4bcf-8051-5f029d6804ff admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.593744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.594381 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.594661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.594935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] PATH_INFO: `/v3/projects/cbc9626ac5e34c81b2479aafbe8e86e7/users/b1a75b5df0ab460b85c8db5bc6f83f00/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.609881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9626ac5e34c81b2479aafbe8e86e7, user_id=b1a75b5df0ab460b85c8db5bc6f83f00, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.612560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779895d-e829-4bef-b8e2-f41e6eb35261 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.682363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.682712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.683129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.704921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:44.707254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:44.727586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1200/2419] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:44 2022] PUT /identity/v3/projects/cbc9626ac5e34c81b2479aafbe8e86e7/users/b1a75b5df0ab460b85c8db5bc6f83f00/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:44.734046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.734332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.734603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.763785 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] MFA Rules not processed for user `b1a75b5df0ab460b85c8db5bc6f83f00`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:44.765069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:44.785878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1220/2420] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:44.844447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1201/2421] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:44.845060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.857638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aace2-4ad7-4fa6-97e0-c2be632e40ca None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:44.905534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:44.921672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:44.922300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:44.922582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:44.922879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:44.924452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:44.925451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:44.986424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:44.987840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:45.018878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1221/2422] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:44 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:45.025178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.027858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:45.086714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:45.102683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da50de-c73a-4e26-9276-8d62ec6cfb7a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.137079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ab47-07ab-43cd-865b-720813f0c80a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.146101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.146972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.147305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.147633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.150323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:45.169867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.172138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.181094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.181808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.182796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.182796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.186167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1222/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:45.189079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.281407 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.283193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.285415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1ec-7351-4b15-875b-dbb2c01647c2 service nova] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.290306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.291448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.291448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.291448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.292102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.294094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1202/2424] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 15:01:45.294240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.408652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1223/2425] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:45 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:45.409953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.427500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74587-5e23-482c-963a-2c1a7d6ca3d6 service swift] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.447302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.448008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.448447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.448765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.449434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.451088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.469013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1203/2426] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:45.469967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.487010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67fc9b-2996-4ccc-a2c9-8477e9dceb5b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.511965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.517274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.517731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.518013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] PATH_INFO: `/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de/users/5158c6f2f4514d7ea9e5406a1e60731f/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.553075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9bf30280c4444ebedd9fbf7906f2de, user_id=5158c6f2f4514d7ea9e5406a1e60731f, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.556178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.675874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1224/2427] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:45 2022] PUT /identity/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de/users/5158c6f2f4514d7ea9e5406a1e60731f/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:45.677277 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.694772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b2f-35ea-49e5-a8ec-4656c4ef29ef admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.819415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.820341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.821247 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.821747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.824713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.826377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d564d-64cb-476a-9d23-317d1e1a4620 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.841934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1204/2428] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:45.843548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:45.861365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460579b-6cb9-4eb6-be62-c52f31afd9bc admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:45.866869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:45.868358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.868848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.869267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] PATH_INFO: `/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de/users/5158c6f2f4514d7ea9e5406a1e60731f/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.872078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9bf30280c4444ebedd9fbf7906f2de, user_id=5158c6f2f4514d7ea9e5406a1e60731f, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:45.876758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:45.893461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1225/2429] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:45 2022] PUT /identity/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de/users/5158c6f2f4514d7ea9e5406a1e60731f/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:45.901815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:45.902077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:45.902359 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:45.957662 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] MFA Rules not processed for user `5158c6f2f4514d7ea9e5406a1e60731f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:45.960018 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:45.982588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:46.086156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1205/2430] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:46.098156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:46.099929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:46.119626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:46.192752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8dbd-b576-42e2-90a3-d8efd0396214 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:46.197169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:46.198266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:46.198681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:46.199141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:46.214819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:46.217045 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:46.238835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1226/2431] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:46.481759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:46.493545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb63e6d-889d-4302-b137-c2ad3889e7cf None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:46.498352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:46.499167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:46.499513 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:46.499859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:46.579913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:46.581430 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6ff3-4bdd-4f2e-924a-c06ed44875ee service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:46.592936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1206/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:47.263219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:47.363318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134eb5e-113c-4eac-804f-ed8c843183bc service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:47.370885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:47.373535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:47.373975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:47.374500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] PATH_INFO: `/v3/users/b1a75b5df0ab460b85c8db5bc6f83f00` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:47.375636 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a75b5df0ab460b85c8db5bc6f83f00)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:47.377836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:47.624336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a75b5df0ab460b85c8db5bc6f83f00'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:47.652965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a75b5df0ab460b85c8db5bc6f83f00'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:47.662086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a75b5df0ab460b85c8db5bc6f83f00'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:47.663665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a75b5df0ab460b85c8db5bc6f83f00'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:47.666554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a75b5df0ab460b85c8db5bc6f83f00'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:47.735447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1227/2433] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:47 2022] DELETE /identity/v3/users/b1a75b5df0ab460b85c8db5bc6f83f00 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:47.745464 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:47.745868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:47.746034 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:47.799753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:47.804197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:47.907075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1207/2434] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:47.918302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:47.919485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:47.960719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:47.994412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c5843-f7aa-4a37-8da4-da81d2f89c60 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:47.999838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:47.999838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:47.999838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:47.999838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:48.012548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:48.016786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:48.032732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1228/2435] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:48.686897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:48.688327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:48.737198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe8f9-ba12-432a-9bda-505a44f4309f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:48.744782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:48.745439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:48.745951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:48.746482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] PATH_INFO: `/v3/projects/cbc9626ac5e34c81b2479aafbe8e86e7` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:48.747497 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc9626ac5e34c81b2479aafbe8e86e7)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:48.759409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:48.945107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:48.951234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc9626ac5e34c81b2479aafbe8e86e7', 'request_id': 'req-822542fa-45b6-476c-8643-a6960a22ebb2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:48.960940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc9626ac5e34c81b2479aafbe8e86e7', 'request_id': 'req-822542fa-45b6-476c-8643-a6960a22ebb2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:48.971899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc9626ac5e34c81b2479aafbe8e86e7', 'request_id': 'req-822542fa-45b6-476c-8643-a6960a22ebb2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.284157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] The token cache is being invalidate because project cbc9626ac5e34c81b2479aafbe8e86e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:49.284966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.286265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.298443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:49.299220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1208/2436] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:48 2022] DELETE /identity/v3/projects/cbc9626ac5e34c81b2479aafbe8e86e7 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:49.309259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b71-d6a8-4185-aed3-1be1da6ff0fd service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:49.391750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:49.392492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:49.395941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:49.395941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] PATH_INFO: `/v3/users/5158c6f2f4514d7ea9e5406a1e60731f` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:49.395941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5158c6f2f4514d7ea9e5406a1e60731f)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:49.401418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:49.616888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5158c6f2f4514d7ea9e5406a1e60731f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.640587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5158c6f2f4514d7ea9e5406a1e60731f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.658022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5158c6f2f4514d7ea9e5406a1e60731f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.659144 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5158c6f2f4514d7ea9e5406a1e60731f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.660547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c048cefb-00b6-465a-ab28-c4e2f3ee9290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5158c6f2f4514d7ea9e5406a1e60731f'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:49.772425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1229/2437] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:49 2022] DELETE /identity/v3/users/5158c6f2f4514d7ea9e5406a1e60731f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:50.300696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:50.300696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:50.341752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822542fa-45b6-476c-8643-a6960a22ebb2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:50.472752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:50.473705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:50.473986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:50.474260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] PATH_INFO: `/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:50.475435 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9bf30280c4444ebedd9fbf7906f2de)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:50.477580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:50.658677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9bf30280c4444ebedd9fbf7906f2de', 'request_id': 'req-003be57c-a1d2-44a6-b226-0147246d0eaa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:50.666712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9bf30280c4444ebedd9fbf7906f2de', 'request_id': 'req-003be57c-a1d2-44a6-b226-0147246d0eaa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:50.675881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9bf30280c4444ebedd9fbf7906f2de', 'request_id': 'req-003be57c-a1d2-44a6-b226-0147246d0eaa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:50.770190 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] The token cache is being invalidate because project 6b9bf30280c4444ebedd9fbf7906f2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:50.770500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:50.774493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-003be57c-a1d2-44a6-b226-0147246d0eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:50.779647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1209/2438] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:50 2022] DELETE /identity/v3/projects/6b9bf30280c4444ebedd9fbf7906f2de => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:50.781346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:50.781812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:50.781916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:50.823676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:50.823676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:50.883876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:50.934787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1230/2439] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:50.942906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:50.948422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:50.948422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:50.975627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:50.977541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:50.987414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1210/2440] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:50.991913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.007349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be287f-54a3-4045-aac4-023189f33aa0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.014908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.015677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.015963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.016229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.017075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:51.017380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.019850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.039095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.045326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1231/2441] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:51.050112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b795-1210-488d-aae9-55be31c12d6a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.056860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.063766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.063766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.063766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.063766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.063766 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.185100 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1211/2442] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:01:51.186798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.198408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beebd7-7084-4fdc-ada0-0e2090edab9a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.282628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.284358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.284793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.285062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.285749 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.287677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.369884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1232/2443] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:51 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:51.373534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.391086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6985e4-4db1-4621-a47d-c9bdfcc05c43 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.396269 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.397431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.397944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.398452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.399893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.402207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.415504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1212/2444] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:51.419433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.436625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36363-0899-4c26-b99e-45e8f9d4fa39 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.444300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.445097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.446189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.446389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.447255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.448957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863db5c-827e-44c6-b263-62baf20d28e3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.465799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1233/2445] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:51.468307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.481415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dac7-4d49-4847-b1e3-9bd101662fae admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.496403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.497749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.498177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.498459 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] PATH_INFO: `/v3/projects/c41530ac90e844babfbf669c265a1d78/users/9b6a17d8b48d488596066d5278a705a0/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.522398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41530ac90e844babfbf669c265a1d78, user_id=9b6a17d8b48d488596066d5278a705a0, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.526397 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.650523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:51.656699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1213/2446] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:51 2022] PUT /identity/v3/projects/c41530ac90e844babfbf669c265a1d78/users/9b6a17d8b48d488596066d5278a705a0/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:51.666233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.666593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.666770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.702400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] MFA Rules not processed for user `9b6a17d8b48d488596066d5278a705a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:51.703838 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:51.780638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1234/2447] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:51.792834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.794823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:51.871964 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b96a75-5d10-49a9-96df-5a5a82f1bee4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:51.878554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:51.879298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:51.880106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:51.880470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:51.893083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:51.895264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c502b9-bf61-4c93-a2f9-64af68e244f6 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:51.907735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1214/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:01:51.933263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:51.990072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:52.005674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244243d3-bcd9-4a39-b27f-d6ff28a9c1a6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:52.012248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:52.012955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.013230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.013503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] PATH_INFO: `/v3/users/9b6a17d8b48d488596066d5278a705a0` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.014281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d96e-3d65-4a28-ba6d-022defcc044b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.014703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6a17d8b48d488596066d5278a705a0)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:52.015025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d96e-3d65-4a28-ba6d-022defcc044b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.015559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d96e-3d65-4a28-ba6d-022defcc044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.016689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:52.040585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2548d96e-3d65-4a28-ba6d-022defcc044b None None] MFA Rules not processed for user `460f88282f7441648850c92bfa8a2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:52.042292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2548d96e-3d65-4a28-ba6d-022defcc044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:52.124628 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1215/2449] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:52.199928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6a17d8b48d488596066d5278a705a0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.213542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6a17d8b48d488596066d5278a705a0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.223198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6a17d8b48d488596066d5278a705a0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.224039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6a17d8b48d488596066d5278a705a0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.224642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6a17d8b48d488596066d5278a705a0'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:52.288280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1235/2450] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:01:51 2022] DELETE /identity/v3/users/9b6a17d8b48d488596066d5278a705a0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:52.293717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.294007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.294358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.324248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:52.324953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:52.438625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1216/2451] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:52.451498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:52.452989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:52.526632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcb71f-59d0-4b8a-a593-8d7b95c60f4f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:52.530430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:52.531048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:52.531334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:52.531630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:52.543842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:52.546295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0667dbf-c004-4f79-aa6e-685ed0876bbb service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:52.560718 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1236/2452] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:53.218232 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.220079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.252868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0addc-55cb-461f-ba2c-2fcc2ef7956a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.262186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.263219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.264927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.265732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] PATH_INFO: `/v3/projects/c41530ac90e844babfbf669c265a1d78` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.270881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41530ac90e844babfbf669c265a1d78)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.279794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.407537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:53.418687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41530ac90e844babfbf669c265a1d78', 'request_id': 'req-3dbc4f3d-594a-4cad-a584-818b5647144c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.427082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41530ac90e844babfbf669c265a1d78', 'request_id': 'req-3dbc4f3d-594a-4cad-a584-818b5647144c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.434186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41530ac90e844babfbf669c265a1d78', 'request_id': 'req-3dbc4f3d-594a-4cad-a584-818b5647144c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.490171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] The token cache is being invalidate because project c41530ac90e844babfbf669c265a1d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:01:53.491139 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.491963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-3dbc4f3d-594a-4cad-a584-818b5647144c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:01:53.498496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1217/2453] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:01:53 2022] DELETE /identity/v3/projects/c41530ac90e844babfbf669c265a1d78 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:53.502074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.502591 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.502692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.530556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:53.534951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.622337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1237/2454] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:53.630894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.631439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.631874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.656248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:53.666689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:53.672942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.677883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1218/2455] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:53.685314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320e31-1d1b-44d2-bb40-7fe2ef8255b5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.694758 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.696149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.696753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.697301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.698269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:01:53.698978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.700934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.709451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:53.721841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.724886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1238/2456] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:01:53.734069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5311f-de7d-408d-9422-043862d5e8a9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:53.739570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:53.740636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:53.741505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:53.741995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:53.743659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:53.746483 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:53.912849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1219/2457] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:53 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:53.918286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:53.932989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97a401-33ac-4f4c-b86c-3a49a0714dfd admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.020698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.021367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.021655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.021933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.022576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.026143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.104090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1239/2458] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:53 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:54.107937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.131632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2157-f573-46d2-9c32-6c4c4dffda12 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.139240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.140291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.140291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.140599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.141127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.145510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.180353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1220/2459] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:54.184628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.197893 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db520415-d17a-4e22-bea7-70c574ad92c4 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.205713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.206325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.206734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.219641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.220362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.222086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5edf-3658-492c-a68d-98aefb092b27 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.243443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1240/2460] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:54.244717 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.261699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958de5c-e9e2-4fb0-97c0-f0330de9f680 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.281437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.282187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.282482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.282810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] PATH_INFO: `/v3/projects/f4889382577c4a829672fe3fda40d24e/users/93579456a83f42b0a6f31390540380b3/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.311813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4889382577c4a829672fe3fda40d24e, user_id=93579456a83f42b0a6f31390540380b3, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.314707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.439330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1221/2461] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:54 2022] PUT /identity/v3/projects/f4889382577c4a829672fe3fda40d24e/users/93579456a83f42b0a6f31390540380b3/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:54.452691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.452986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.453260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.499378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] MFA Rules not processed for user `93579456a83f42b0a6f31390540380b3`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:54.500736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:54.596820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1241/2462] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:54.601101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.685783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cfb7b-2f96-4867-9108-e4e9e361ba9b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.691550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.692161 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.692457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.692910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.693551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.696177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.861960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1222/2463] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:54.866124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:54.881932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282f94-247f-4c95-97d6-7d545f3a0c9e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:54.957285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:54.958140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:54.958420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:54.958689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:54.959324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:54.962568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:54.987514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:55.057253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1242/2464] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:54 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:55.061571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.129510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732fde-fa7d-49b4-ac29-57e307558ec5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.144475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.149007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.149307 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.151399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.152167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.156123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.196815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1223/2465] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:55.198054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.216043 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8512-6af2-428d-bb86-0ccbbee4b390 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.231113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.255915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.257167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.257451 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.261305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.265465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5991af8-c133-4773-bc2d-87851a8f5f32 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.317399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1243/2466] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:55.322104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.337127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0a42a-7fa4-4693-b052-df3186c957d7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.344394 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.348421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.349110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.349762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] PATH_INFO: `/v3/projects/a62b367d55154c37827cd4e39aa5273d/users/0ecd82ef7f0e47e397fef5e69b64a952/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.378787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62b367d55154c37827cd4e39aa5273d, user_id=0ecd82ef7f0e47e397fef5e69b64a952, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.382125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:55.474949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1224/2467] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:55 2022] PUT /identity/v3/projects/a62b367d55154c37827cd4e39aa5273d/users/0ecd82ef7f0e47e397fef5e69b64a952/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:55.486176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.486461 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.486727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.567357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] MFA Rules not processed for user `0ecd82ef7f0e47e397fef5e69b64a952`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:55.569263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:55.733026 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1244/2468] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:01:55.740331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:55.791384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:55.874021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f9b6-38db-46f2-8938-2febdcdbc764 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:55.885601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:55.886297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:55.886579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:55.886854 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:55.887498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:55.893290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.013646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1225/2469] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:56.019138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.045093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea0ec-f203-4fd4-b345-03a3ef587078 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.128001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.128918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.129299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.130871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.130871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.132449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.226071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1245/2470] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:01:56 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:01:56.233660 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.268526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8e21-615c-47ec-a199-d3aa1418846d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.290419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.291708 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.292141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.293209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.295170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.296073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.337183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1226/2471] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:01:56.343112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.355689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b883fa-553c-40cc-9688-c61c7b216438 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.370689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.371380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.371664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.371940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] PATH_INFO: `/v3/projects/16d05992387044ccaad8c907b59be940/users/698efefb54e24928a2a9b7de904c318a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.433432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d05992387044ccaad8c907b59be940, user_id=698efefb54e24928a2a9b7de904c318a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.444822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.579229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1246/2472] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:56 2022] PUT /identity/v3/projects/16d05992387044ccaad8c907b59be940/users/698efefb54e24928a2a9b7de904c318a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:01:56.583181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.598918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3f08-e9c2-4b96-a671-c8b200e0b174 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.695239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.696242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.696815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.697165 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.697892 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.700437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cbee7-0118-4e38-b2f3-c8743c51b740 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.719358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:56.720406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1227/2473] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:01:56.733759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d1c87-7488-49fc-aef9-830871bb7aa6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:56.739559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:56.740072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.740423 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.740809 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] PATH_INFO: `/v3/projects/16d05992387044ccaad8c907b59be940/users/698efefb54e24928a2a9b7de904c318a/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.743494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d05992387044ccaad8c907b59be940, user_id=698efefb54e24928a2a9b7de904c318a, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:56.747109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:56.763186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1247/2474] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:01:56 2022] PUT /identity/v3/projects/16d05992387044ccaad8c907b59be940/users/698efefb54e24928a2a9b7de904c318a/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:01:56.787324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:56.788477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:56.788789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:56.859956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] MFA Rules not processed for user `698efefb54e24928a2a9b7de904c318a`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:01:56.861379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:57.001238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1228/2475] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:01:57.016653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:57.018500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:57.067265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:57.109702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa634ed-dca9-403b-a31c-886dec83d484 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:57.116060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:57.116060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:57.121867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:57.121867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:57.220395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:57.221942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:57.246584 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1248/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:01:59.606236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:01:59.608651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:01:59.622537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7e57-a528-4b57-8aa8-70fac3579e2f None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:01:59.626879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:01:59.627516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:01:59.627952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:01:59.628422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:01:59.641314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:59.697771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:01:59.699240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:01:59.709021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1229/2477] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:01:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:01.114622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:01.124182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b7ba1-2de8-4d07-b4e5-bd7bcd876674 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:01.132503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:01.132503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:01.132503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:01.132503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:01.139997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:01.141647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:01.153117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1249/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:03.274582 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:03.275400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:03.352803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5b6a1-096c-43db-b48f-227f70bfccf8 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:03.358648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:03.359258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:03.359545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:03.359816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:03.362580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:03.376039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:03.377683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:03.389199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1230/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:03.468320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:03.470107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:03.529269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124f2f3-a64c-4a6c-b112-2f1e563a8ef2 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:03.533834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:03.534435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:03.534713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:03.534988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:03.536808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:03.606719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:03.608203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c85df-dc9f-4b94-9d06-f81b0a9f7155 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:03.618141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1250/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:05.918944 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:05.934174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e123d8-8748-4aa5-86e9-22598cea7099 service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:05.940055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:05.941094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:05.941591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:05.942216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] PATH_INFO: `/v3/users/93579456a83f42b0a6f31390540380b3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:05.943640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93579456a83f42b0a6f31390540380b3)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:05.946046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.150044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93579456a83f42b0a6f31390540380b3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.151050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93579456a83f42b0a6f31390540380b3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.158109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93579456a83f42b0a6f31390540380b3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.250380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93579456a83f42b0a6f31390540380b3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.255905 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93579456a83f42b0a6f31390540380b3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:06.270337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1231/2481] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:05 2022] DELETE /identity/v3/users/93579456a83f42b0a6f31390540380b3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:06.275865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.276338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.276435 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.295291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:06.296502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.308823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:06.362020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1251/2482] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:06.369617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.372347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.385378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:06.433095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c9a9-471c-4426-9b03-c05a0672a675 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.436884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.437486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.437765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.438036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.448233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.449759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:06.460076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1232/2483] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:06.901902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:06.903625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:06.917816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f64349-e01c-42c2-9f9f-ddee8a9a2f37 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:06.922785 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:06.923637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:06.924768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:06.925194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] PATH_INFO: `/v3/projects/f4889382577c4a829672fe3fda40d24e` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:06.926722 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4889382577c4a829672fe3fda40d24e)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:06.929616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.044916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4889382577c4a829672fe3fda40d24e', 'request_id': 'req-5ae6e7d7-c864-4465-9441-0ea772f4131a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.051289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4889382577c4a829672fe3fda40d24e', 'request_id': 'req-5ae6e7d7-c864-4465-9441-0ea772f4131a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.058528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4889382577c4a829672fe3fda40d24e', 'request_id': 'req-5ae6e7d7-c864-4465-9441-0ea772f4131a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.141651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] The token cache is being invalidate because project f4889382577c4a829672fe3fda40d24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:07.141948 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.148319 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-5ae6e7d7-c864-4465-9441-0ea772f4131a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.153702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1252/2484] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:06 2022] DELETE /identity/v3/projects/f4889382577c4a829672fe3fda40d24e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:07.154959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:07.166222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9682e7-d186-4a9a-a100-ed26ee99a39a service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:07.254119 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:07.254774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:07.255063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:07.255340 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] PATH_INFO: `/v3/users/0ecd82ef7f0e47e397fef5e69b64a952` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:07.256865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecd82ef7f0e47e397fef5e69b64a952)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:07.259547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:07.481027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecd82ef7f0e47e397fef5e69b64a952'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.481573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecd82ef7f0e47e397fef5e69b64a952'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.488444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecd82ef7f0e47e397fef5e69b64a952'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.553868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecd82ef7f0e47e397fef5e69b64a952'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.555011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecd82ef7f0e47e397fef5e69b64a952'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:07.575745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1233/2485] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:07 2022] DELETE /identity/v3/users/0ecd82ef7f0e47e397fef5e69b64a952 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:08.288252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.288966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.288966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.310103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:08.311378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.372104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1253/2486] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:08.385974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.388837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.431722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:08.460482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.462388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.506599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa0430-0acf-4a92-9af8-30c49a50bf10 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:08.526182 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:08.526874 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.527152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.528429 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.544848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.548384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.562629 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1234/2487] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:02:08.581462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:08.606500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1e37-b9c6-4304-9383-d7a2feb41900 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:08.612332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:08.613335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.613769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.614190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] PATH_INFO: `/v3/projects/a62b367d55154c37827cd4e39aa5273d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.616307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62b367d55154c37827cd4e39aa5273d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.618561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.663304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.664176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.752693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62b367d55154c37827cd4e39aa5273d', 'request_id': 'req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.764391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62b367d55154c37827cd4e39aa5273d', 'request_id': 'req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.766961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac41f3-07f5-4a3b-ae1c-d11360fb3f58 service swift] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:08.772525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62b367d55154c37827cd4e39aa5273d', 'request_id': 'req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.896829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:08.897570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:08.897875 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:08.898138 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:08.901312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.911494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] The token cache is being invalidate because project a62b367d55154c37827cd4e39aa5273d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:08.912408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.914492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:08.918471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:08.920115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1254/2488] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:08 2022] DELETE /identity/v3/projects/a62b367d55154c37827cd4e39aa5273d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:08.921566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:08.923390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:08.925783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:08.946058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1235/2489] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:08.953664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.068245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25c0c-11e6-4b67-96f8-0abafb0676e3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.077279 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:09.085480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8843b-40d8-4730-93a0-a8e8a9f72957 service placement] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:09.086788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.087638 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.088072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.088499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] PATH_INFO: `/v3/users/488eb88e27ed47e7856e999ef96efb69` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.089880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488eb88e27ed47e7856e999ef96efb69)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.092006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.094325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:09.095211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:09.095737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:09.096159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] PATH_INFO: `/v3/users/698efefb54e24928a2a9b7de904c318a` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:09.099118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698efefb54e24928a2a9b7de904c318a)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:09.102957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:09.329876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488eb88e27ed47e7856e999ef96efb69'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.353513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488eb88e27ed47e7856e999ef96efb69'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.360765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698efefb54e24928a2a9b7de904c318a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.364362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698efefb54e24928a2a9b7de904c318a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.365186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488eb88e27ed47e7856e999ef96efb69'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.366498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488eb88e27ed47e7856e999ef96efb69'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.367408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488eb88e27ed47e7856e999ef96efb69'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.382792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698efefb54e24928a2a9b7de904c318a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.445275 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1255/2490] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:08 2022] DELETE /identity/v3/users/488eb88e27ed47e7856e999ef96efb69 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:09.479416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:09.518638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698efefb54e24928a2a9b7de904c318a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.519424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698efefb54e24928a2a9b7de904c318a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:09.551550 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1236/2491] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:08 2022] DELETE /identity/v3/users/698efefb54e24928a2a9b7de904c318a => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:09.834801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:09.837523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:09.974640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec043-dc13-4f82-a350-995983d570c6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.108426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.109671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.110035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.110388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] PATH_INFO: `/v3/projects/4e87f0ff186d4b739208bf2b8aa2cf20` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.112222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e87f0ff186d4b739208bf2b8aa2cf20)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.114305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.229288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.231067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.255647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270421b3-2d89-4614-aca6-12d2fe185750 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.286409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e87f0ff186d4b739208bf2b8aa2cf20', 'request_id': 'req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.295993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e87f0ff186d4b739208bf2b8aa2cf20', 'request_id': 'req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.307600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e87f0ff186d4b739208bf2b8aa2cf20', 'request_id': 'req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.344993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.345885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.346174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.346488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] PATH_INFO: `/v3/projects/16d05992387044ccaad8c907b59be940` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.347799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d05992387044ccaad8c907b59be940)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.350523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.384917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] The token cache is being invalidate because project 4e87f0ff186d4b739208bf2b8aa2cf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:10.385445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.387337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-789f261b-b0db-44c2-9fe2-3e7bbce98b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.391203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1256/2492] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:09 2022] DELETE /identity/v3/projects/4e87f0ff186d4b739208bf2b8aa2cf20 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:10.396145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.396433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.396740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.425860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.427488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.444647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1257/2493] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:10.445531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.448037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.489453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:10.502895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d05992387044ccaad8c907b59be940', 'request_id': 'req-72b09fb6-4d73-466b-a6eb-a01deca64283'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.515296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d05992387044ccaad8c907b59be940', 'request_id': 'req-72b09fb6-4d73-466b-a6eb-a01deca64283'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.526265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d05992387044ccaad8c907b59be940', 'request_id': 'req-72b09fb6-4d73-466b-a6eb-a01deca64283'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.558018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696c60-da69-4ca4-a1f3-0b157935d5aa None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.665773 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.666562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.666928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.667181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.669170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.683706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] The token cache is being invalidate because project 16d05992387044ccaad8c907b59be940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:10.684897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.688114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-72b09fb6-4d73-466b-a6eb-a01deca64283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:10.690349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.690920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1237/2494] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:10 2022] DELETE /identity/v3/projects/16d05992387044ccaad8c907b59be940 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:10.692799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798203a-b048-480e-b86a-dcf3dbb57964 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.694141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.694614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.694778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.708476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1258/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:10.710226 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28be92e-c80b-4bb6-8701-ac67292b3c85 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.710630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28be92e-c80b-4bb6-8701-ac67292b3c85 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.710905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28be92e-c80b-4bb6-8701-ac67292b3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.718290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:10.761659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d28be92e-c80b-4bb6-8701-ac67292b3c85 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.764552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.765917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.774498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d28be92e-c80b-4bb6-8701-ac67292b3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.916004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1238/2496] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:10.920581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:10.921409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1259/2497] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:10.927888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.928173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.928441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.939092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b6c49-5688-4a46-aaf2-45d2538bdcdf None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:10.947646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:10.948949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:10.949533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:10.950037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:10.953692 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:10.953853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:10.956373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:10.976702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1239/2498] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:10.977608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:10.978909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:10.980652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.001496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1260/2499] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:11.003233 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.019345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00883c24-ccc9-4b0a-aedb-831a18dd1cd6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.019715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a07c-016d-42a1-9e75-6e87ed675371 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.027132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.028653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.029259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.029817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.030724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.031140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:11.031335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.032254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.033819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.034112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.034762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.035951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.042748 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.063470 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1261/2500] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:11.066818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.086071 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0fa75-fe7b-41d6-9ddb-d808b31447e5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.096308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.097780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.097780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.098294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.099484 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.104452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.163633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1240/2501] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:10 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.170069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.262252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1262/2502] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.277042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.299038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:11.342819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ce902-abd6-47dd-bc0a-fd71e3e6cf21 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.433345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.433993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.434274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.434546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.436115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.438233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.448146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead77535-2be7-43f7-9684-09bf9b6323f4 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.475072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.479033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.479534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.480690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.481747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.484964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.538064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1241/2503] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.539096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.547195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:11.554062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff65896-08fd-4d33-bd4b-51059917aac2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.559970 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.560704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.561067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.561361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.562037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.563780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.580765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1242/2504] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:11.581687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.592977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9655-f4f9-44f3-abd2-8e05f20d1a43 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.598275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.598936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.599220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.599491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.600186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.602671 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.624704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1243/2505] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:11.624915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1263/2506] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:11.625020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.626397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.638762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee7ef-26f3-41ec-96b8-18f6251ec100 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.659291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a934f-cc15-4573-bcce-afebb005a576 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.659565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.659565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.659565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.659565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.659883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.659883 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.660062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.665207 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.667779 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.668084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] PATH_INFO: `/v3/projects/5564c114aa7d46bbbb63e87935cf7749/users/1b9b00ce140e48c6b88d51ebfaf528ad/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.674305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1264/2507] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:11.676073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.698973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e8ff-362d-447d-acd1-a8436b407932 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.709267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.709910 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.710169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.710449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.711107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.713523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.733221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564c114aa7d46bbbb63e87935cf7749, user_id=1b9b00ce140e48c6b88d51ebfaf528ad, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.736409 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ad4a9-a8c5-43f3-a671-3ce0c0066b75 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.746762 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1265/2508] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:11.747688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:11.766523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b39-3014-404b-b6d0-7ded9faf106c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:11.777784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:11.779625 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.781741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.782647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] PATH_INFO: `/v3/projects/e80da941a84a48be9913a9f9f26094e7/users/85e2b8f6de0e4d85a403e4a471078560/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.805108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80da941a84a48be9913a9f9f26094e7, user_id=85e2b8f6de0e4d85a403e4a471078560, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:11.812092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874955-8ee4-4759-9d2e-58f106319380 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:11.842593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1244/2509] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:11 2022] PUT /identity/v3/projects/5564c114aa7d46bbbb63e87935cf7749/users/1b9b00ce140e48c6b88d51ebfaf528ad/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:11.854480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.854776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.855643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.896755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1266/2510] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:11 2022] PUT /identity/v3/projects/e80da941a84a48be9913a9f9f26094e7/users/85e2b8f6de0e4d85a403e4a471078560/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:11.901579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:11.901870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:11.902140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:11.902616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] MFA Rules not processed for user `1b9b00ce140e48c6b88d51ebfaf528ad`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:11.903952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:11.934755 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:11.936038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:12.048973 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1245/2511] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:12.066772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:12.069221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:12.115598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1267/2512] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:12.125679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:12.128247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:12.237222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971342e-da35-4f12-96d8-220847c4e1d7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:12.250077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:12.251009 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:12.251456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:12.251862 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:12.263085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb35c-f4f9-4a26-9221-09bad6a6470b None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:12.269380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:12.270106 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:12.270393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:12.270668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:12.274506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:12.276451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288892-1391-43bd-ba0e-52ce30390a7f service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:12.304565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:12.309765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:12.315776 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:12.317494 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1246/2513] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:12.342020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1268/2514] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:14.159472 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e395dd-0b99-4370-a656-7cd5ea8d6395 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.160199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e395dd-0b99-4370-a656-7cd5ea8d6395 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.160199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e395dd-0b99-4370-a656-7cd5ea8d6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.214148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b1e395dd-0b99-4370-a656-7cd5ea8d6395 None None] MFA Rules not processed for user `85e2b8f6de0e4d85a403e4a471078560`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:14.214148 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b1e395dd-0b99-4370-a656-7cd5ea8d6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:14.259134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:14.330909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1247/2515] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:14.341497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:14.346018 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:14.420651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aacff-2461-4546-8134-68b5e753c509 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:14.425057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:14.427178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:14.427529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:14.427953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:14.466720 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:14.468174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:14.490490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1269/2516] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:16.337789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.338942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.339674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.363010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] MFA Rules not processed for user `85e2b8f6de0e4d85a403e4a471078560`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:16.365044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:16.380276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1248/2517] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:16.725744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:16.736428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aa1ea-b33d-48f1-96cb-c4077b626a5d service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:16.740123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:16.740737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:16.741023 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:16.741296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:16.743848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:16.762936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:16.764477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3a0ac-74b9-45bc-beb1-c46225710ee9 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:16.773516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1270/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:18.906917 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:18.918255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e536-9a45-463f-984b-f54f49e37284 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:18.922798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:18.923426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:18.923707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:18.923982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] PATH_INFO: `/v3/users/1b9b00ce140e48c6b88d51ebfaf528ad` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:18.925175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9b00ce140e48c6b88d51ebfaf528ad)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:18.927355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:19.090541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9b00ce140e48c6b88d51ebfaf528ad'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.091211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9b00ce140e48c6b88d51ebfaf528ad'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.098242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9b00ce140e48c6b88d51ebfaf528ad'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.158109 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9b00ce140e48c6b88d51ebfaf528ad'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.158734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9b00ce140e48c6b88d51ebfaf528ad'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.178344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1249/2519] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:18 2022] DELETE /identity/v3/users/1b9b00ce140e48c6b88d51ebfaf528ad => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:19.183669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:19.184199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:19.184199 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:19.204097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:19.205344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:19.285274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1271/2520] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:19.295241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:19.296859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:19.364616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80257-4181-42f1-8590-c48e1410a3d2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:19.369304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:19.369942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:19.370806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:19.371085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:19.380682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:19.382152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236238a-c56b-4b9f-858e-b3a719267d63 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:19.392420 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1250/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:19.843172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:19.844575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:19.857313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c108c-87b0-4804-9400-dc4c2cd1c523 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:19.861928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:19.862547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:19.862822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:19.863087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] PATH_INFO: `/v3/projects/5564c114aa7d46bbbb63e87935cf7749` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:19.864197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5564c114aa7d46bbbb63e87935cf7749)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:19.866198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:19.973737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5564c114aa7d46bbbb63e87935cf7749', 'request_id': 'req-9ea98998-751c-4756-bb39-aa77e2d0cd67'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.982489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5564c114aa7d46bbbb63e87935cf7749', 'request_id': 'req-9ea98998-751c-4756-bb39-aa77e2d0cd67'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:19.989567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5564c114aa7d46bbbb63e87935cf7749', 'request_id': 'req-9ea98998-751c-4756-bb39-aa77e2d0cd67'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.059403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] The token cache is being invalidate because project 5564c114aa7d46bbbb63e87935cf7749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:20.059621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.060253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9ea98998-751c-4756-bb39-aa77e2d0cd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:20.062004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1272/2522] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:19 2022] DELETE /identity/v3/projects/5564c114aa7d46bbbb63e87935cf7749 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:20.066658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.067151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.067419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.088290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:20.089761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:20.123111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:20.160032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1251/2523] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:20.169614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.169900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.170203 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.192165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:20.193447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:20.202745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1273/2524] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:20.207314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.218547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6020f0-7706-4a5e-b5ed-f1479a65cc93 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.223383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.223986 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.224264 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.224604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.225250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:20.225576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.227184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.241710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1252/2525] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:20.247141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.252286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:20.258280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020138a2-a071-4bf9-a4f5-3a07e96e6d9a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.264618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.265296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.265631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.267163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.267163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.268805 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.362872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1274/2526] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:20.367078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.383518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6d47-beef-4ddd-905b-820f9ef9455d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.454568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.454952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.455772 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.457598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.458723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.460565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.545857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1253/2527] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:20.550020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.563165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7da20-1ee7-482e-b4ac-6e8017150f9f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.569252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.570115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.570490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.570862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.572726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.578814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.589673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1275/2528] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:20.590966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.605856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd120e-46cf-4e46-a22e-dd602f92239e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.611503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.612145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.612423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.612716 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.613484 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.614966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc9421-a3f6-4677-b719-43a22bf6459c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.626649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1254/2529] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:20.630760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.654511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f009d2-bd25-4267-8846-feff774a8b16 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.674742 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.681261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.681261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.681261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] PATH_INFO: `/v3/projects/ccd8c0b2f331455787b7c7fc86f6319c/users/d9f6388ce4ec458e8700770fb021087c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.695025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd8c0b2f331455787b7c7fc86f6319c, user_id=d9f6388ce4ec458e8700770fb021087c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.698979 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:20.775908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1276/2530] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:20 2022] PUT /identity/v3/projects/ccd8c0b2f331455787b7c7fc86f6319c/users/d9f6388ce4ec458e8700770fb021087c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:20.787371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.787666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.788184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.825596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] MFA Rules not processed for user `d9f6388ce4ec458e8700770fb021087c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:20.827146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:20.903668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1255/2531] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:20.907745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:20.980757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13f840-bd5b-4903-837a-1fac498d50b3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:20.985558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:20.986224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:20.986568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:20.986903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:20.987596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:20.989763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.088950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1277/2532] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:20 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:21.090095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.101073 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad4b4c-0fba-4555-bbba-babd39d01dd8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.130280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:21.205492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.205807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.206321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.206776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.207636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.209642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.322167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1256/2533] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:21 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:21.322747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.334988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7f72-b130-4b6e-8460-fca5afee1aad admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.343715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.344415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.344960 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.345341 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.346328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.348243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.364848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1278/2534] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:21.368174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.379226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c392-544c-45ba-b9b3-32a9ccd719af admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.386248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.389157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.389157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.389157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] PATH_INFO: `/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee/users/ab14d786dd5649efac32a833d16413bc/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.405787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5096dc8e4044c88acbf7e9ed19e04ee, user_id=ab14d786dd5649efac32a833d16413bc, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.409215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.505270 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1257/2535] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:21 2022] PUT /identity/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee/users/ab14d786dd5649efac32a833d16413bc/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:21.509239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.519632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16329604-08ab-4fea-947e-8f5b77d8be3b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.586389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.587974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.588260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.588530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.589207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.592750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d50f8c-b845-49c5-8f50-62958af75a07 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.601188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1279/2536] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:21.606309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.617458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dff547-122d-4e1c-89cf-80b8dbd17ec8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.622449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.623104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.623797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.623797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] PATH_INFO: `/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee/users/ab14d786dd5649efac32a833d16413bc/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.625649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5096dc8e4044c88acbf7e9ed19e04ee, user_id=ab14d786dd5649efac32a833d16413bc, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.628442 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.640183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1258/2537] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:21 2022] PUT /identity/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee/users/ab14d786dd5649efac32a833d16413bc/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:21.651588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.651928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.652168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.684761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] MFA Rules not processed for user `ab14d786dd5649efac32a833d16413bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:21.685996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:21.690725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:21.762860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1280/2538] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:21.776193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:21.778221 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:21.842154 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f59cb-9461-459e-bca3-ccc800b131f6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:21.846366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:21.847007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:21.847290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:21.847563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:21.860319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:21.865829 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917f28-1817-4d8f-b7e4-6d22f304a937 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:21.874857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1259/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:22.019998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:22.083527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bacf52-5660-400b-9670-9128ebf07a97 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:22.089999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:22.090719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:22.091030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:22.091315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] PATH_INFO: `/v3/users/d9f6388ce4ec458e8700770fb021087c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:22.093166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f6388ce4ec458e8700770fb021087c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:22.095119 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.046062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.046062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.046062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.056026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:23.057395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.114474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1260/2540] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:23.127086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.128448 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.143308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f6388ce4ec458e8700770fb021087c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.156064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f6388ce4ec458e8700770fb021087c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.160625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:23.165937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f6388ce4ec458e8700770fb021087c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.165937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f6388ce4ec458e8700770fb021087c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.165937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f6388ce4ec458e8700770fb021087c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:23.200373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7526-0ef2-4f5c-b400-6cd1b7a77864 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.206741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.207349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.207626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.207894 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.209694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.220422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.222048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cc3e-4fa1-48a7-9b92-120d32ff26af service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.230142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1261/2541] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:02:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:02:23.292401 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1281/2542] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:22 2022] DELETE /identity/v3/users/d9f6388ce4ec458e8700770fb021087c => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:23.292563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.292888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.293166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.318098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:23.318098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.372888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1262/2543] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:23.382533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.384137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:23.408860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:23.450326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861e1ad-7cf0-4ccf-8b15-f0f020c71663 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:23.453917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:23.454525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:23.454802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:23.455070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:23.466291 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:23.468074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:23.478617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1282/2544] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:23.994088 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:23.995538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:24.007798 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc459f5-13de-4d79-861f-43cf9da56da6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.013059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.013689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.013967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.014238 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] PATH_INFO: `/v3/projects/ccd8c0b2f331455787b7c7fc86f6319c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.015505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd8c0b2f331455787b7c7fc86f6319c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.017502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.146016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd8c0b2f331455787b7c7fc86f6319c', 'request_id': 'req-47473390-a6d5-4fca-865b-274eab6dcfb8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.153856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd8c0b2f331455787b7c7fc86f6319c', 'request_id': 'req-47473390-a6d5-4fca-865b-274eab6dcfb8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.162482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd8c0b2f331455787b7c7fc86f6319c', 'request_id': 'req-47473390-a6d5-4fca-865b-274eab6dcfb8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.248288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] The token cache is being invalidate because project ccd8c0b2f331455787b7c7fc86f6319c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:24.248594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.249404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.251173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1263/2545] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:23 2022] DELETE /identity/v3/projects/ccd8c0b2f331455787b7c7fc86f6319c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:24.254996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:24.266547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311305-9434-4a6b-9d1c-83c68349f34d service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:24.323266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:24.323878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:24.324147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:24.324418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] PATH_INFO: `/v3/users/ab14d786dd5649efac32a833d16413bc` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:24.325565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab14d786dd5649efac32a833d16413bc)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:24.327490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:24.524704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab14d786dd5649efac32a833d16413bc'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.536716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab14d786dd5649efac32a833d16413bc'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.543938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab14d786dd5649efac32a833d16413bc'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.546821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab14d786dd5649efac32a833d16413bc'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.546821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9685a3ef-3f5b-432e-8329-83ced5556678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab14d786dd5649efac32a833d16413bc'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:24.630234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1283/2546] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:24 2022] DELETE /identity/v3/users/ab14d786dd5649efac32a833d16413bc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:25.187470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:25.188992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:25.212500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47473390-a6d5-4fca-865b-274eab6dcfb8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:25.263345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:25.288851 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:25.289502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.289897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.290924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] PATH_INFO: `/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.292446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5096dc8e4044c88acbf7e9ed19e04ee)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:25.295107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:25.457895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5096dc8e4044c88acbf7e9ed19e04ee', 'request_id': 'req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:25.469132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5096dc8e4044c88acbf7e9ed19e04ee', 'request_id': 'req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:25.472956 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5096dc8e4044c88acbf7e9ed19e04ee', 'request_id': 'req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:25.568133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] The token cache is being invalidate because project b5096dc8e4044c88acbf7e9ed19e04ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:25.568427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:25.569104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-71d7462a-2295-4a4f-9bf4-5f3dd8cfc58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:25.570637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1264/2547] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:25 2022] DELETE /identity/v3/projects/b5096dc8e4044c88acbf7e9ed19e04ee => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:25.576380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.576921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.577070 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.597689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:25.598887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:25.636559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:25.658705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1284/2548] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:25.666647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.666950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.667220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.687245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:25.688463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:25.697318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1265/2549] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:25.703064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:25.713400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096ef8c-1e2f-4988-8297-8afd3933f909 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:25.718971 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:25.719590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.719865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.720134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.720812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:25.721111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:25.722736 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:25.734441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1285/2550] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:25.738822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:25.749651 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e5404-5c52-48c0-aee8-e50a457fc2a4 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:25.754332 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:25.754915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.757656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.757656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.757656 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:25.759701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:25.849963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1266/2551] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:25 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:25.851297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:25.862970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4a0f-1851-41fa-81f4-56ad1986b293 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:25.923775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:25.924382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:25.924642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:25.924939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:25.925599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:25.927611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.004335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1286/2552] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:25 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:26.011706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.020039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c26e-d330-41c1-be6d-5f5b20bbf83f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.024857 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.025732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.026010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.026278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.026921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.028647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.039096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1267/2553] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:26.043994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.056590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ab2a7-c9e2-4577-a3c4-3a125e8de563 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.063335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.064001 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.064238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.064503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.065168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.069090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959927-281e-47b5-aac0-7d2d11fa1d67 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.077764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1287/2554] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:26.081900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.092106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7ce72-80de-41ff-9783-9774ea52de7f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.096715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.097352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.097633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.097907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] PATH_INFO: `/v3/projects/e8e933bcbd2a4fbb9b9c0df88a51ccb1/users/38fd6cdec54d4e5fbf4ea5276db4a5cb/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.112938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e933bcbd2a4fbb9b9c0df88a51ccb1, user_id=38fd6cdec54d4e5fbf4ea5276db4a5cb, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.115606 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.186610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1268/2555] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:26 2022] PUT /identity/v3/projects/e8e933bcbd2a4fbb9b9c0df88a51ccb1/users/38fd6cdec54d4e5fbf4ea5276db4a5cb/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:26.197078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.197363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.197666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.225564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] MFA Rules not processed for user `38fd6cdec54d4e5fbf4ea5276db4a5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:26.226841 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:26.297274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1288/2556] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:26.302396 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.367943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746d5d9-2288-4c11-b976-570f9c292559 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.372722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.373318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.373599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.373912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.374546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.376439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.388489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:26.488288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1269/2557] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:26 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:26.489330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.500526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc61e-1260-441d-9d6c-f1f4618830eb None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.536817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:26.559902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.560504 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.560806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.561074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.561697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.563692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.672261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1289/2558] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:26 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:26.676457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.686932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf191c-9d66-4eb2-be4f-42d5ec0bba17 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.691869 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.695943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.695943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.695943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.695943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.695943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.705623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1270/2559] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:26.709713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.720441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000d1f-c872-43d1-97cd-544f394724d8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.724950 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.725573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.725846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.726113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] PATH_INFO: `/v3/projects/fdf51c1e6942425f8561627c77af5eae/users/6993fca468e4428fb3f74f67b3a7fdf3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.741137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf51c1e6942425f8561627c77af5eae, user_id=6993fca468e4428fb3f74f67b3a7fdf3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.744212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.818853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1290/2560] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:26 2022] PUT /identity/v3/projects/fdf51c1e6942425f8561627c77af5eae/users/6993fca468e4428fb3f74f67b3a7fdf3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:26.823257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.833338 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e1b1-5472-41da-b80e-b3793dd6daff admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.889925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.890522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.890802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.891072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.891709 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.893357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a842-e72c-4c52-b2c8-7a2cb2ca6e10 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.903916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1271/2561] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:26.908031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:26.919150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2781da-b228-40dd-b5fc-db9f210f15f1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:26.923821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:26.924489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.924813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.925082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] PATH_INFO: `/v3/projects/fdf51c1e6942425f8561627c77af5eae/users/6993fca468e4428fb3f74f67b3a7fdf3/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.926986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf51c1e6942425f8561627c77af5eae, user_id=6993fca468e4428fb3f74f67b3a7fdf3, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:26.929655 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:26.939827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1291/2562] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:26 2022] PUT /identity/v3/projects/fdf51c1e6942425f8561627c77af5eae/users/6993fca468e4428fb3f74f67b3a7fdf3/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:26.951316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:26.951605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:26.951883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:26.980159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] MFA Rules not processed for user `6993fca468e4428fb3f74f67b3a7fdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:26.981401 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:27.047792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1272/2563] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:27.059318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:27.061014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:27.117576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8572b-5667-40c8-9a10-892cc091fd22 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:27.121477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:27.122054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:27.122328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:27.122588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:27.131488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:27.132982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a1f9-3fe2-4877-bf24-1d7c3de92156 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:27.143017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1292/2564] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:27.342195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:27.351951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03f4dd-b81c-4bf7-b89f-11e1b74d1a04 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:27.356132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:27.356771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:27.357050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:27.357317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:27.418537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:27.420031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:27.425010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:27.430965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1273/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:34.803819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62557fa-a89f-4b0c-9523-4e6a9bb87e99 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:34.804249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62557fa-a89f-4b0c-9523-4e6a9bb87e99 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:34.804501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62557fa-a89f-4b0c-9523-4e6a9bb87e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:34.830107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c62557fa-a89f-4b0c-9523-4e6a9bb87e99 None None] MFA Rules not processed for user `85e2b8f6de0e4d85a403e4a471078560`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:34.831457 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c62557fa-a89f-4b0c-9523-4e6a9bb87e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:34.887483 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1293/2566] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:36.094194 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:36.158615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad25d-8eea-4177-9c78-7757c7d70c73 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:36.163202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:36.163818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:36.164103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:36.164375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] PATH_INFO: `/v3/users/38fd6cdec54d4e5fbf4ea5276db4a5cb` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:36.165522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fd6cdec54d4e5fbf4ea5276db4a5cb)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:36.167492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:36.350267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fd6cdec54d4e5fbf4ea5276db4a5cb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.350848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fd6cdec54d4e5fbf4ea5276db4a5cb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.359125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fd6cdec54d4e5fbf4ea5276db4a5cb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.448377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fd6cdec54d4e5fbf4ea5276db4a5cb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.449017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fd6cdec54d4e5fbf4ea5276db4a5cb'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:36.467985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1274/2567] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:36 2022] DELETE /identity/v3/users/38fd6cdec54d4e5fbf4ea5276db4a5cb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:36.472594 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:36.473128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:36.473243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:36.492388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:36.493621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:36.525778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:36.553721 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1294/2568] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:36.566172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:36.566898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:36.626830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8902-1200-4e5b-875f-8089c1bb4b64 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:36.630549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:36.631158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:36.631437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:36.631707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:36.645547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:36.647132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:36.659233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1275/2569] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:37.103935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.105855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:37.118430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418ead-0e81-42ea-b8f0-e23a31e5ab66 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.124173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.124577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.124889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.125160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] PATH_INFO: `/v3/projects/e8e933bcbd2a4fbb9b9c0df88a51ccb1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.126289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e933bcbd2a4fbb9b9c0df88a51ccb1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.128238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.267985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e933bcbd2a4fbb9b9c0df88a51ccb1', 'request_id': 'req-4a6499f0-659e-4abf-a0c7-8775ea5d508b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.274391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e933bcbd2a4fbb9b9c0df88a51ccb1', 'request_id': 'req-4a6499f0-659e-4abf-a0c7-8775ea5d508b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.280390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e933bcbd2a4fbb9b9c0df88a51ccb1', 'request_id': 'req-4a6499f0-659e-4abf-a0c7-8775ea5d508b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.346171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] The token cache is being invalidate because project e8e933bcbd2a4fbb9b9c0df88a51ccb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:37.346454 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.347075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.348558 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1295/2570] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:37 2022] DELETE /identity/v3/projects/e8e933bcbd2a4fbb9b9c0df88a51ccb1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:37.352624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:37.362586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62960f5-c808-4066-8b6c-f6dc173e5819 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:37.380940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:37.418602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:37.419794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:37.420086 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:37.420362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] PATH_INFO: `/v3/users/6993fca468e4428fb3f74f67b3a7fdf3` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:37.421537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6993fca468e4428fb3f74f67b3a7fdf3)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:37.423463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:37.650189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6993fca468e4428fb3f74f67b3a7fdf3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.651128 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6993fca468e4428fb3f74f67b3a7fdf3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.658626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6993fca468e4428fb3f74f67b3a7fdf3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.767431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6993fca468e4428fb3f74f67b3a7fdf3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.768040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-585b70d8-6b95-4a4a-b943-95870776281f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6993fca468e4428fb3f74f67b3a7fdf3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:37.787375 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1276/2571] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:37 2022] DELETE /identity/v3/users/6993fca468e4428fb3f74f67b3a7fdf3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:38.388730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.390620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.405852 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6499f0-659e-4abf-a0c7-8775ea5d508b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.470719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.471499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.471876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.472152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] PATH_INFO: `/v3/projects/fdf51c1e6942425f8561627c77af5eae` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.473296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf51c1e6942425f8561627c77af5eae)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.475265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.572163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf51c1e6942425f8561627c77af5eae', 'request_id': 'req-efbd5b4f-8963-4c23-82ff-ef27038cb11c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:38.578978 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf51c1e6942425f8561627c77af5eae', 'request_id': 'req-efbd5b4f-8963-4c23-82ff-ef27038cb11c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:38.584728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf51c1e6942425f8561627c77af5eae', 'request_id': 'req-efbd5b4f-8963-4c23-82ff-ef27038cb11c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:38.586363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:38.676086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] The token cache is being invalidate because project fdf51c1e6942425f8561627c77af5eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:38.676433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:38.677114 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-efbd5b4f-8963-4c23-82ff-ef27038cb11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:38.678842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1296/2572] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:38 2022] DELETE /identity/v3/projects/fdf51c1e6942425f8561627c77af5eae => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:38.684389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.685500 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.685690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.706134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:38.707353 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.771050 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1277/2573] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:38.779447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.779763 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.779988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.806262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:38.806262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:38.814308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1297/2574] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:38.818693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.830636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0c8c-3ced-468e-aafa-f3cb2aff76ee None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.839443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.840095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.845800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.845800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.845800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:38.845800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.845800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.859474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1278/2575] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:38.864005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:38.875099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0fa4-aa4c-48d8-a0b5-b94639b53489 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:38.880007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:38.880768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:38.881050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:38.881315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:38.881956 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:38.883965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:38.987514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1298/2576] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:38.990899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.002197 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa86d-bfed-4547-bcdd-d813773397e3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.031306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:39.063710 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.064308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.064586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.064959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.065588 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.067670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.146912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1279/2577] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:38 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:39.151434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.161840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b7f2-0e6f-422f-a038-b8d1231e38fb admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.166873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.167467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.167745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.168014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.168671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.173753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.181833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1299/2578] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:39.186171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.197196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c92-03d0-4915-85f7-76769376e0cf admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.202200 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.202800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.203094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.204749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.204749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.206322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c743fbc-13bb-490d-b6b3-35e34d4a8cb4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.218473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1280/2579] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:39.223490 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.233265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bb558-1e20-47d6-800b-bf4763f04c2a admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.238982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.239627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.239947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.240214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] PATH_INFO: `/v3/projects/8a1ec584cfe44011a01fa321a57ec9b1/users/8ca5f2e20c294b11af02237f6ea26c93/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.264489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1ec584cfe44011a01fa321a57ec9b1, user_id=8ca5f2e20c294b11af02237f6ea26c93, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.267529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.350705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1300/2580] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:39 2022] PUT /identity/v3/projects/8a1ec584cfe44011a01fa321a57ec9b1/users/8ca5f2e20c294b11af02237f6ea26c93/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:02:39.361346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.361654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.361926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.391952 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] MFA Rules not processed for user `8ca5f2e20c294b11af02237f6ea26c93`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:39.393203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:39.466812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1281/2581] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:39.468057 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.540646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf3e77-cdcc-4f1b-b0c6-7369912c07f6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.545769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.546499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.547028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.547314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.547952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.549888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.666445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1301/2582] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:39 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:02:39.670478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.682533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc51f7-2ea1-4ded-aecf-f30b4b395cb5 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.740739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.741392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.741610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.741880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.742522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.744462 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.869989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1282/2583] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:39 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:39.871221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.882424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394520fe-e52b-4675-ae3a-4f6a25b28e99 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.886942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.887525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.887802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.888072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.888744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.890443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:39.901510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1302/2584] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:39.906025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:39.915974 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04db4-c874-49db-b141-47cf643ad965 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:39.920512 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:39.921742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:39.922043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:39.922315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] PATH_INFO: `/v3/projects/cc8af36190644b4ba8c5b1b2a117697c/users/277a7e113d5c42d9b25bcc112e90a057/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:39.939280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8af36190644b4ba8c5b1b2a117697c, user_id=277a7e113d5c42d9b25bcc112e90a057, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:39.942020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.050858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1283/2585] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:39 2022] PUT /identity/v3/projects/cc8af36190644b4ba8c5b1b2a117697c/users/277a7e113d5c42d9b25bcc112e90a057/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:40.051161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:40.058540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e914-552c-404b-8a18-f7b220c6dede admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:40.122329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:40.122930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.123208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.123506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.124179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:40.125822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4116bf6-63a7-4abb-b44e-f7185ac08174 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.130032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:40.138780 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1303/2586] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:40.145626 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:40.151523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:40.157895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6d2f-40c1-4c5f-b767-5a9d823cab03 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:40.162985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:40.163637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.163913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.164180 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] PATH_INFO: `/v3/projects/cc8af36190644b4ba8c5b1b2a117697c/users/277a7e113d5c42d9b25bcc112e90a057/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.166179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8af36190644b4ba8c5b1b2a117697c, user_id=277a7e113d5c42d9b25bcc112e90a057, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:40.168886 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.180685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1284/2587] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:40 2022] PUT /identity/v3/projects/cc8af36190644b4ba8c5b1b2a117697c/users/277a7e113d5c42d9b25bcc112e90a057/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:40.193236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.193519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.193798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.223066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] MFA Rules not processed for user `277a7e113d5c42d9b25bcc112e90a057`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:40.224305 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:40.293464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1304/2588] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:40.307098 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:40.308738 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:40.371753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f5e84-3926-491e-9d23-0139451d4aca admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:40.376070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:40.376686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:40.377045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:40.377314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:40.432790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:40.434225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:40.443980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1285/2589] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:42.133187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:42.134566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:42.147074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf705ca3-6b40-4d1f-91f6-ee32526d0e68 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:42.150839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:42.151421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:42.151699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:42.151972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:42.161878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:42.163321 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddd24f-1042-43a3-a0bf-a1a4ba2e1058 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:42.173016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1305/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:46.551170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:46.614516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1818-0122-4d98-a6f1-bf290197ee4a service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:46.618972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:46.619633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:46.619910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:46.620177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] PATH_INFO: `/v3/users/8ca5f2e20c294b11af02237f6ea26c93` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:46.621301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca5f2e20c294b11af02237f6ea26c93)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:46.623212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:46.817557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:46.819212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca5f2e20c294b11af02237f6ea26c93'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:46.819979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca5f2e20c294b11af02237f6ea26c93'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:46.827233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca5f2e20c294b11af02237f6ea26c93'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:46.895403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca5f2e20c294b11af02237f6ea26c93'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:46.896033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca5f2e20c294b11af02237f6ea26c93'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:46.916466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1286/2591] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:46 2022] DELETE /identity/v3/users/8ca5f2e20c294b11af02237f6ea26c93 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:46.921140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:46.921621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:46.922399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:46.947295 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:46.948497 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:47.018645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1306/2592] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:47.021343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:47.022733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:47.028493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:47.030047 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:47.092468 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1aea9-52e4-4703-a039-d1a5eb2fd7c1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:47.096364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:47.096995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:47.097272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:47.097536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:47.103722 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a9b-1784-495c-a33d-0bb250e7ca79 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:47.106856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:47.108288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:47.110173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:47.111043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:47.111248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:47.111516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:47.113355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:47.119850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1307/2593] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:02:47.190367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:47.192594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:47.204474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1287/2594] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:47.603327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:47.604781 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:47.626871 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1870a-bffe-42bb-9358-5d833a561ca1 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:47.632073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:47.632715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:47.632997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:47.633270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] PATH_INFO: `/v3/projects/8a1ec584cfe44011a01fa321a57ec9b1` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:47.634391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1ec584cfe44011a01fa321a57ec9b1)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:47.636323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:47.645397 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:47.755876 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1ec584cfe44011a01fa321a57ec9b1', 'request_id': 'req-89d27f29-1fe5-4c91-9dfa-f725095e6370'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:47.762004 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1ec584cfe44011a01fa321a57ec9b1', 'request_id': 'req-89d27f29-1fe5-4c91-9dfa-f725095e6370'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:47.767681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1ec584cfe44011a01fa321a57ec9b1', 'request_id': 'req-89d27f29-1fe5-4c91-9dfa-f725095e6370'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:47.869404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] The token cache is being invalidate because project 8a1ec584cfe44011a01fa321a57ec9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:47.869723 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:47.870366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:47.871880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1308/2595] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:47 2022] DELETE /identity/v3/projects/8a1ec584cfe44011a01fa321a57ec9b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:47.876399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:47.887059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d5071-c9ce-447f-b063-56815b143d3d service nova] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:47.946613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:47.947248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:47.947519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:47.947788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] PATH_INFO: `/v3/users/277a7e113d5c42d9b25bcc112e90a057` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:47.948943 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277a7e113d5c42d9b25bcc112e90a057)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:47.951037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:47.952524 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:48.183846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277a7e113d5c42d9b25bcc112e90a057'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.184523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277a7e113d5c42d9b25bcc112e90a057'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.192107 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277a7e113d5c42d9b25bcc112e90a057'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.295218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277a7e113d5c42d9b25bcc112e90a057'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.295827 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6f4a0073-de1b-4719-8594-5972c5dd5c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277a7e113d5c42d9b25bcc112e90a057'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:48.314423 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1288/2596] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:47 2022] DELETE /identity/v3/users/277a7e113d5c42d9b25bcc112e90a057 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:48.916421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:48.918035 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:48.938187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27f29-1fe5-4c91-9dfa-f725095e6370 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.018928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.019560 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.019830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.020097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] PATH_INFO: `/v3/projects/cc8af36190644b4ba8c5b1b2a117697c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.021313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8af36190644b4ba8c5b1b2a117697c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.023374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.158822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8af36190644b4ba8c5b1b2a117697c', 'request_id': 'req-f1a526d8-77b7-491a-9c4d-887b04e5be3b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.165204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8af36190644b4ba8c5b1b2a117697c', 'request_id': 'req-f1a526d8-77b7-491a-9c4d-887b04e5be3b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.170892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8af36190644b4ba8c5b1b2a117697c', 'request_id': 'req-f1a526d8-77b7-491a-9c4d-887b04e5be3b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.241230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] The token cache is being invalidate because project cc8af36190644b4ba8c5b1b2a117697c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:49.241680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.242452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f1a526d8-77b7-491a-9c4d-887b04e5be3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:49.248909 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1309/2597] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:48 2022] DELETE /identity/v3/projects/cc8af36190644b4ba8c5b1b2a117697c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:49.251519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.252020 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.253324 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.295141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:49.295141 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.360594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1289/2598] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:49.368670 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.368969 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.369238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.392125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:49.393354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:49.402858 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1310/2599] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:49.408199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.418039 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6677b5-ab96-451b-8e10-837b9cb6bc68 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.422757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.423413 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.423696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.423966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.424613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:49.424961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.426571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.438206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1290/2600] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:02:49.442609 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.451972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3b607-c968-44d8-9676-38b8414b21fe None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.457279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.457864 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.458140 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.458434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.459073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.460999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.547798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:49.556178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1311/2601] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:49.559837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.570916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49253e-c475-4149-89d7-9d758a7b368c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.631959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.632684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.633038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.633382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.634135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.636275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.648383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:49.716137 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1291/2602] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:49.720935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.731284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bf0-c45a-41ce-b7f2-feb741f3b88f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.736520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.737145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.737426 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.737697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.738335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.739937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.754629 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1312/2603] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:02:49.754737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.765036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fd6c-f7c3-47ff-89c1-59ef1d14e37f admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.771404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.772019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.772297 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.773801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.778922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.778922 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f44b21-0a1e-46a8-a42a-b6779d9615cd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.788676 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1292/2604] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:02:49.793327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:49.810941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8297d-8a32-4b20-9a5c-21ba0a39e5ef admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:49.817788 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:49.818523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.818725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.818995 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] PATH_INFO: `/v3/projects/6d524b4bd4544247828b4fb0f3951ea4/users/0af1df8803f64304b83175ac344726a5/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.836289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d524b4bd4544247828b4fb0f3951ea4, user_id=0af1df8803f64304b83175ac344726a5, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:49.839534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:49.922257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1313/2605] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:02:49 2022] PUT /identity/v3/projects/6d524b4bd4544247828b4fb0f3951ea4/users/0af1df8803f64304b83175ac344726a5/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:49.933955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ff0-d64a-40ea-bd44-be7aea242f3e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:49.934236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ff0-d64a-40ea-bd44-be7aea242f3e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:49.934504 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ff0-d64a-40ea-bd44-be7aea242f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:49.962881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-effe8ff0-d64a-40ea-bd44-be7aea242f3e None None] MFA Rules not processed for user `0af1df8803f64304b83175ac344726a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:49.964094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-effe8ff0-d64a-40ea-bd44-be7aea242f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:50.031151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1293/2606] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:50.041935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:50.043693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:50.100598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fed83f-4f2d-4f5c-bfa9-e466da776b11 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:50.104240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:50.104862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:50.105139 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:50.105410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:50.114215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:50.115632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:50.124360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1314/2607] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:53.198439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.198975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.198975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.219840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:53.221169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:53.280233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1294/2608] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:53.306659 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:53.308099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:53.398217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ffa2-9eb6-4f98-bea4-545feb9099b2 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:53.404118 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:53.404879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:53.405231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:53.405506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:53.414997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:53.416623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1488a-f0e3-46b4-8098-be626e880ba8 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:53.426466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1315/2609] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 15:02:57.335721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:57.441961 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c180dc8-01b1-4205-81af-e8d009ef4588 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:57.447254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:57.447980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:57.448473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:57.449085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] PATH_INFO: `/v3/users/0af1df8803f64304b83175ac344726a5` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:57.450305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af1df8803f64304b83175ac344726a5)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:57.452732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:57.485704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:57.701620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af1df8803f64304b83175ac344726a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.701620 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af1df8803f64304b83175ac344726a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.713284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af1df8803f64304b83175ac344726a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.813030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af1df8803f64304b83175ac344726a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.813450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af1df8803f64304b83175ac344726a5'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:57.863540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1295/2610] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:02:57 2022] DELETE /identity/v3/users/0af1df8803f64304b83175ac344726a5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:57.868171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:57.869661 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:57.870162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:57.895038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:57.897518 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:57.958052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:57.983942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1316/2611] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:02:57.993868 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:57.997701 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:58.067024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c931f93-14bf-41d6-a216-17e3a249c4e4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.071084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.071762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.072111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.072452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.090101 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.092202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9abf04-0cf6-4364-8325-9a6db8132e34 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:58.108114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1296/2612] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:58.752331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:58.753996 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:58.773502 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612faaff-6489-4eec-bb15-1da3de372205 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:58.796080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:58.809466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:58.819607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:58.819607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] PATH_INFO: `/v3/projects/6d524b4bd4544247828b4fb0f3951ea4` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:58.820863 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d524b4bd4544247828b4fb0f3951ea4)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:58.826012 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.074028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d524b4bd4544247828b4fb0f3951ea4', 'request_id': 'req-50d884e2-5cd4-481a-8ec1-c91d7da864bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:59.094985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d524b4bd4544247828b4fb0f3951ea4', 'request_id': 'req-50d884e2-5cd4-481a-8ec1-c91d7da864bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:59.114323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d524b4bd4544247828b4fb0f3951ea4', 'request_id': 'req-50d884e2-5cd4-481a-8ec1-c91d7da864bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:59.198371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] The token cache is being invalidate because project 6d524b4bd4544247828b4fb0f3951ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:02:59.198732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:59.199879 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-50d884e2-5cd4-481a-8ec1-c91d7da864bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:02:59.201916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1317/2613] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:02:58 2022] DELETE /identity/v3/projects/6d524b4bd4544247828b4fb0f3951ea4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:02:59.207571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.208156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.208363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.270573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:59.275474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:59.482449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1297/2614] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:59.489469 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.489903 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.490168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.553290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:02:59.560485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:59.587195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1318/2615] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:02:59.596703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.608981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.611466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308502-0ab0-4a64-9def-e78fc8aac470 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.613444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:59.635989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.637953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.638242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.638516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.641661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:02:59.644924 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.647634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.684285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1298/2616] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:02:59.689317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.719918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faee78-cf04-49c2-b5e1-bcd65827a7f7 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.741387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.742022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.742310 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.742600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.743260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.751083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.754453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a93649-6be6-479d-aa4a-50a74e0af9f4 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:02:59.758654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:02:59.759576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:02:59.760176 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:02:59.760691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:02:59.762835 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:02:59.777562 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:02:59.779429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:02:59.792953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1319/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:02:59.880231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1299/2618] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:02:59.881752 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:02:59.892489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508b8a-2e16-45be-a3c0-05eee8a745dc service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.020331 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.021728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.022015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.022287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.023433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.025391 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.136870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1320/2619] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:02:59 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:00.141538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.162043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14c7f7-b9c2-44ce-8daa-31202a12b7cb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.174380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.175296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.175702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.176078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.180331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.186693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.193989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:00.214542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1300/2620] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:00.218111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.226084 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:00.232520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c1-f924-4a8b-8525-b33bfd7c4cd7 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.238516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.239447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.239983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.240546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.241546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.253410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef365b-719f-4369-b0d1-695b2435f4e4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.272017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1321/2621] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:00.273242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.293652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da674b66-d4de-4283-b67d-663a518722fc admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.308106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.309426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.310177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.310789 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] PATH_INFO: `/v3/projects/d2381d00ef794cd386cfff6223787668/users/7ee984645de345c2958415c1ba1e719c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.340913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2381d00ef794cd386cfff6223787668, user_id=7ee984645de345c2958415c1ba1e719c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.345898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.446053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1301/2622] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:00 2022] PUT /identity/v3/projects/d2381d00ef794cd386cfff6223787668/users/7ee984645de345c2958415c1ba1e719c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:00.448293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.448911 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.449346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.505984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] MFA Rules not processed for user `7ee984645de345c2958415c1ba1e719c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:00.507623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:00.604059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1322/2623] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:00.611638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.687678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989586a-6057-4b0a-932e-eeba5c69548e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.693146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.694170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.694602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.694871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.695792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.697744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:00.831072 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1302/2624] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:00 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:00.834694 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:00.846691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43868be7-536a-4b1a-874e-3f64d83e8dd0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:00.939653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:00.940431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:00.940968 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:00.941346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:00.942088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:00.944213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:01.073092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1323/2625] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:00 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:01.078449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:01.090746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5a83-a18a-4714-a058-15397dc9cee2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:01.096140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:01.104835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:01.104835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:01.104835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:01.104835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:01.104835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:01.116245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1303/2626] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:01.118262 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:01.130365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc84d7-fbb5-426f-a7e5-99b7df896434 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:01.135474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:01.136187 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:01.136466 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:01.136775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] PATH_INFO: `/v3/projects/6064f0ac0d2849afa8873c10fc727a76/users/2c5db146d20540b0892098a2c5461b8b/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:01.158173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6064f0ac0d2849afa8873c10fc727a76, user_id=2c5db146d20540b0892098a2c5461b8b, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:01.161174 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:01.430215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1324/2627] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:01 2022] PUT /identity/v3/projects/6064f0ac0d2849afa8873c10fc727a76/users/2c5db146d20540b0892098a2c5461b8b/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:01.431698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:01.451316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251430d-ed84-4715-be31-3989057f8d01 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:01.610778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:01.611624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:01.611923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:01.612198 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:01.612914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:01.623042 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfee10-9ac7-44c3-a150-033ab59c8e2c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:01.649369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:01.649616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1304/2628] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:01.663500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3cd9-6a47-45a0-b8ac-edc249de8dff admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:01.682330 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:01.686211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:01.686211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:01.686211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] PATH_INFO: `/v3/projects/6064f0ac0d2849afa8873c10fc727a76/users/2c5db146d20540b0892098a2c5461b8b/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:01.687536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6064f0ac0d2849afa8873c10fc727a76, user_id=2c5db146d20540b0892098a2c5461b8b, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:01.691055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:01.734088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1325/2629] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:01 2022] PUT /identity/v3/projects/6064f0ac0d2849afa8873c10fc727a76/users/2c5db146d20540b0892098a2c5461b8b/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:01.734351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:01.734639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:01.735116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:01.800111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] MFA Rules not processed for user `2c5db146d20540b0892098a2c5461b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:01.804236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:01.872021 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:01.944909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1305/2630] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:01.955761 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:01.957929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:02.015075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:02.042833 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b876c-61cc-4d57-830f-194cf651feb2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:02.047575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:02.048186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:02.048489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:02.048751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:02.122380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:02.123836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37b74d-90ec-4c19-a9e6-68039c98d49d service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:02.161234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1326/2631] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:05.915841 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:06.002061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7f72f-f17a-4bf8-b877-ea5a9d0fdf53 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:06.010968 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:06.011776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:06.013215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:06.013950 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] PATH_INFO: `/v3/users/7ee984645de345c2958415c1ba1e719c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:06.016226 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee984645de345c2958415c1ba1e719c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:06.034780 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:06.253949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee984645de345c2958415c1ba1e719c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:06.254654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee984645de345c2958415c1ba1e719c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:06.264612 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee984645de345c2958415c1ba1e719c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:06.335370 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee984645de345c2958415c1ba1e719c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:06.335787 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee984645de345c2958415c1ba1e719c'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:06.379739 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1306/2632] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:05 2022] DELETE /identity/v3/users/7ee984645de345c2958415c1ba1e719c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:06.381434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:06.381894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:06.382078 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:06.415097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:06.416565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:06.506582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1327/2633] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:06.519053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:06.521426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:06.617848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:06.631482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253f986-31c2-469b-801d-601f4dbf6e90 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:06.636469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:06.637554 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:06.638030 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:06.638454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:06.669176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:06.669176 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:06.673551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1307/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:07.644064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:07.646274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:07.666828 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075cb7-6ed2-4396-8689-8de46fba4dc1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:07.678010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:07.679147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:07.679147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:07.679824 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] PATH_INFO: `/v3/projects/d2381d00ef794cd386cfff6223787668` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:07.681152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2381d00ef794cd386cfff6223787668)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:07.683309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:07.827671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2381d00ef794cd386cfff6223787668', 'request_id': 'req-c8cfcc6c-d221-4274-a30b-e97c31229465'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:07.838191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2381d00ef794cd386cfff6223787668', 'request_id': 'req-c8cfcc6c-d221-4274-a30b-e97c31229465'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:07.846641 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2381d00ef794cd386cfff6223787668', 'request_id': 'req-c8cfcc6c-d221-4274-a30b-e97c31229465'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:07.923492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] The token cache is being invalidate because project d2381d00ef794cd386cfff6223787668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:07.924793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:07.924793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:07.934280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1328/2635] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:07 2022] DELETE /identity/v3/projects/d2381d00ef794cd386cfff6223787668 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:07.937453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:07.953693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3626-00a4-45ad-9761-8b3c56e93bd6 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:08.039867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:08.040567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.042013 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.042309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] PATH_INFO: `/v3/users/2c5db146d20540b0892098a2c5461b8b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.043553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5db146d20540b0892098a2c5461b8b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:08.045918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:08.269343 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5db146d20540b0892098a2c5461b8b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:08.271085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5db146d20540b0892098a2c5461b8b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:08.279991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5db146d20540b0892098a2c5461b8b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:08.354514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5db146d20540b0892098a2c5461b8b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:08.355475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5db146d20540b0892098a2c5461b8b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:08.415157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1308/2636] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:07 2022] DELETE /identity/v3/users/2c5db146d20540b0892098a2c5461b8b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:08.649185 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:08.649998 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:08.671429 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:08.791557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfcc6c-d221-4274-a30b-e97c31229465 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:08.914644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:08.915589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:08.915750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:08.916892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:08.918829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:09.081567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:09.085552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b1fc3-b6a6-4776-a8a0-613093e53672 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:09.116191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1329/2637] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:09.285473 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:09.287239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:09.312457 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6dbd-6409-433a-96bd-b5e402ef09c6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:09.322242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:09.326824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:09.326824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:09.326824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] PATH_INFO: `/v3/projects/6064f0ac0d2849afa8873c10fc727a76` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:09.326824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6064f0ac0d2849afa8873c10fc727a76)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:09.329989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:09.518746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6064f0ac0d2849afa8873c10fc727a76', 'request_id': 'req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:09.533721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6064f0ac0d2849afa8873c10fc727a76', 'request_id': 'req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:09.544756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6064f0ac0d2849afa8873c10fc727a76', 'request_id': 'req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:09.548302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:09.633195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] The token cache is being invalidate because project 6064f0ac0d2849afa8873c10fc727a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:09.633565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:09.634258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b72f5f69-0e8a-4e40-a4cc-41a0773aa895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:09.640783 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1309/2638] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:09 2022] DELETE /identity/v3/projects/6064f0ac0d2849afa8873c10fc727a76 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:09.642603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:09.642887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:09.643159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:09.690096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:09.694116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:09.798501 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1330/2639] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:09.806275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:09.806565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:09.806826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:09.848900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:09.850127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:09.868046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1310/2640] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:09.872222 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:09.885367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8499-53cc-4311-abdd-44f799028463 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:09.892076 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:09.893510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:09.893510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:09.894316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:09.895184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:09.895644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:09.900285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:09.922882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1331/2641] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:09.927691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:09.943732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece255bc-2697-4cd0-b6da-f0192d126551 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:09.950501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:09.951129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:09.951415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:09.951687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:09.952910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:09.955590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.073206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1311/2642] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:09 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:10.074248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.091623 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f212d9-57ca-4baf-b826-763542d1dde2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.108077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=100 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:10.173514 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.175533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:10.211279 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.212405 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.213093 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.214473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.215506 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:10.220302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.293978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8c3a-b0b3-4504-afc8-f8e91ed3d0ae admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.298682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.299243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.299530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.299802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.301580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:10.316699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:10.318214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.325102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1332/2643] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:10 2022] POST /identity/v3/users => generated 282 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:10.329633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.332300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1312/2644] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:10.363117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47afd7-67e6-4608-91c9-e31556962664 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.377901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.378526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.378804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.379077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.379730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:10.382253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.410458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.415542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1333/2645] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:10.420813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8330-b113-4686-bac5-45ece87b0511 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.435204 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.435838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.436126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.436622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.437284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:10.438929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c23eb-56f0-4da9-9aab-ec133b0d25dc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.462880 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1313/2646] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:10.466243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.481927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030deed-529c-4703-ac9f-8e57e931fb53 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.497020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.497739 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.498015 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.498307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] PATH_INFO: `/v3/projects/d8bc4e56bd2a4aa0aebc5ee07dce343b/users/b6ed4048ec7f4c5783892bd3d86aff61/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.531557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bc4e56bd2a4aa0aebc5ee07dce343b, user_id=b6ed4048ec7f4c5783892bd3d86aff61, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:10.538082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:10.628782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1334/2647] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:10 2022] PUT /identity/v3/projects/d8bc4e56bd2a4aa0aebc5ee07dce343b/users/b6ed4048ec7f4c5783892bd3d86aff61/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:10.639108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.640346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.640856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:10.707273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] MFA Rules not processed for user `b6ed4048ec7f4c5783892bd3d86aff61`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:10.709045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:10.867048 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1314/2648] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:10.875042 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:10.878213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:10.984804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe45c5-2c18-4659-9a04-e8c371c6f8b1 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:10.988816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:10.989430 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:10.989709 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:10.989984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:11.013087 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:11.014680 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:11.031365 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1335/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:13.794477 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:13.801845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:13.954900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:14.001951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd3b57-8549-4792-9500-6a1bb0c1eed0 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:14.017521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:14.018223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:14.018506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:14.018777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] PATH_INFO: `/v3/users/3cdaa522829044a49f6e7887195b5cc7` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:14.020108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdaa522829044a49f6e7887195b5cc7)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:14.022121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:14.260982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdaa522829044a49f6e7887195b5cc7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:14.267714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdaa522829044a49f6e7887195b5cc7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:14.283592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdaa522829044a49f6e7887195b5cc7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:14.355318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdaa522829044a49f6e7887195b5cc7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:14.356410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdaa522829044a49f6e7887195b5cc7'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:14.460931 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1315/2650] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:13 2022] DELETE /identity/v3/users/3cdaa522829044a49f6e7887195b5cc7 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:14.906210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:14.929456 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07974e-4edf-4902-8c39-9c9db3fe9a46 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:15.025340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:15.026707 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:15.027336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:15.027768 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] PATH_INFO: `/v3/projects/19dc2c582c344b22982c9e6e8897bc3b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:15.029213 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dc2c582c344b22982c9e6e8897bc3b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:15.031568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:15.045132 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:15.219393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dc2c582c344b22982c9e6e8897bc3b', 'request_id': 'req-c4bd0ee1-37f3-4c53-bff5-d300e5521444'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.230048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dc2c582c344b22982c9e6e8897bc3b', 'request_id': 'req-c4bd0ee1-37f3-4c53-bff5-d300e5521444'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.242713 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dc2c582c344b22982c9e6e8897bc3b', 'request_id': 'req-c4bd0ee1-37f3-4c53-bff5-d300e5521444'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.348715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] The token cache is being invalidate because project 19dc2c582c344b22982c9e6e8897bc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:15.349300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.350231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.356683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:15.359756 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:15.361218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1336/2651] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:14 2022] DELETE /identity/v3/projects/19dc2c582c344b22982c9e6e8897bc3b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:15.384808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e064-8fbc-422c-be0a-db7eb110f2a9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:15.489724 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:15.490901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:15.491439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:15.492489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] PATH_INFO: `/v3/users/5e180380c4104201af7480956f9a3e60` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:15.494288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e180380c4104201af7480956f9a3e60)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:15.496893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:15.770303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e180380c4104201af7480956f9a3e60'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.771140 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e180380c4104201af7480956f9a3e60'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.785536 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e180380c4104201af7480956f9a3e60'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.860802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e180380c4104201af7480956f9a3e60'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.862222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e180380c4104201af7480956f9a3e60'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:15.865053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:15.902821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1316/2652] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:15 2022] DELETE /identity/v3/users/5e180380c4104201af7480956f9a3e60 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:16.281134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:16.282645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:16.308034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd0ee1-37f3-4c53-bff5-d300e5521444 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:16.409563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:16.410192 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:16.410471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:16.410790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] PATH_INFO: `/v3/projects/019d005d4c4d4e8799368a6fe036cb17` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:16.412540 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=019d005d4c4d4e8799368a6fe036cb17)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:16.414598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:16.582820 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019d005d4c4d4e8799368a6fe036cb17', 'request_id': 'req-617cd813-2ac6-49b1-b6e6-f192b876f52b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:16.590052 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019d005d4c4d4e8799368a6fe036cb17', 'request_id': 'req-617cd813-2ac6-49b1-b6e6-f192b876f52b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:16.609229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019d005d4c4d4e8799368a6fe036cb17', 'request_id': 'req-617cd813-2ac6-49b1-b6e6-f192b876f52b'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:16.701263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] The token cache is being invalidate because project 019d005d4c4d4e8799368a6fe036cb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:16.701610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:16.702859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:16.706449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1337/2653] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:16 2022] DELETE /identity/v3/projects/019d005d4c4d4e8799368a6fe036cb17 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:17.672263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:17.673890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:17.705812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4cf2-f44e-4c1d-a929-942c0777041a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:17.798056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:17.798825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:17.799214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:17.799591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] PATH_INFO: `/v3/users/460f88282f7441648850c92bfa8a2b66` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:17.801105 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=460f88282f7441648850c92bfa8a2b66)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:17.803167 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:18.008122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460f88282f7441648850c92bfa8a2b66'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.008830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460f88282f7441648850c92bfa8a2b66'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.017799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460f88282f7441648850c92bfa8a2b66'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.068292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:18.070565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.110583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:18.138044 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460f88282f7441648850c92bfa8a2b66'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.138778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460f88282f7441648850c92bfa8a2b66'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.160704 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1317/2654] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:17 2022] DELETE /identity/v3/users/460f88282f7441648850c92bfa8a2b66 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:18.169994 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd813-2ac6-49b1-b6e6-f192b876f52b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:18.259464 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:18.260206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.260574 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.260939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.263193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.273913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:18.276074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.279215 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:18.282940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:18.298324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1338/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:18.377718 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b9b0-0d0d-4320-9d16-55432ec95ffc admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:18.384599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:18.384816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.384990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.385263 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] PATH_INFO: `/v3/users/a5bf32548bcb4aea809e2561ba2b2f82` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.386437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bf32548bcb4aea809e2561ba2b2f82)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:18.388534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:18.392035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:18.493189 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:18.494099 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.510928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf72c-d7b6-4741-bfbf-a6c8c500256e service placement] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:18.516806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:18.517496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.518495 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.518861 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] PATH_INFO: `/v3/projects/db5e04d4f466443aa29ba91f21659ddd` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.520328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5e04d4f466443aa29ba91f21659ddd)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:18.522369 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:18.690703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bf32548bcb4aea809e2561ba2b2f82'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.692027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bf32548bcb4aea809e2561ba2b2f82'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.694695 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5e04d4f466443aa29ba91f21659ddd', 'request_id': 'req-c32b93c8-bf55-4e3f-a313-20a223765b77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.700282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bf32548bcb4aea809e2561ba2b2f82'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.702598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5e04d4f466443aa29ba91f21659ddd', 'request_id': 'req-c32b93c8-bf55-4e3f-a313-20a223765b77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.708845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5e04d4f466443aa29ba91f21659ddd', 'request_id': 'req-c32b93c8-bf55-4e3f-a313-20a223765b77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.757954 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bf32548bcb4aea809e2561ba2b2f82'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.758669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-f4c05d54-950c-4c9d-9a5b-cd43149e6b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bf32548bcb4aea809e2561ba2b2f82'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.782960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1318/2656] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:18 2022] DELETE /identity/v3/users/a5bf32548bcb4aea809e2561ba2b2f82 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:18.838450 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] The token cache is being invalidate because project db5e04d4f466443aa29ba91f21659ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:18.838687 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.839351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c32b93c8-bf55-4e3f-a313-20a223765b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:18.841110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1339/2657] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:18 2022] DELETE /identity/v3/projects/db5e04d4f466443aa29ba91f21659ddd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:18.846693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.846993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.847271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.869558 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:18.870794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.934298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1319/2658] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:18.943034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.943453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.943829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.966134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:18.968179 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:18.977040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1340/2659] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:18.981614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:18.991754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce36de4-b6af-4e3d-a053-7c504305a41a None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:18.996426 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:18.997056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:18.997335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:18.997605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:18.998257 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:18.998559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.000883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.012889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1320/2660] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:19.017977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.027975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f141e-7a46-42e0-9a7f-52bef313de69 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.033463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.034054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.034332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.034602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.035238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.037170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.079698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.081501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.095390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d553-7858-4ec6-b4d6-232b71a2bf5d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.100160 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.106454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.106454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.106454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] PATH_INFO: `/v3/projects/c0d0b535e1574e5fbb7e13aa21c3614c` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.106454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d0b535e1574e5fbb7e13aa21c3614c)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.106454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.175163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1341/2661] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:19.175163 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.185500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:19.235075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767175be-aa4f-4dc6-b2d3-3f8bece2939c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.239747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.240334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.240606 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.240899 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.241513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.243711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.277793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d0b535e1574e5fbb7e13aa21c3614c', 'request_id': 'req-b6406ce2-8264-4c38-9bd9-fac48bb54950'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:19.284890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d0b535e1574e5fbb7e13aa21c3614c', 'request_id': 'req-b6406ce2-8264-4c38-9bd9-fac48bb54950'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:19.290492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d0b535e1574e5fbb7e13aa21c3614c', 'request_id': 'req-b6406ce2-8264-4c38-9bd9-fac48bb54950'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:19.292147 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:19.330223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1342/2662] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:19.334267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.344424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601a36-00ff-47f7-bd76-194c9acf3b8e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.356927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] The token cache is being invalidate because project c0d0b535e1574e5fbb7e13aa21c3614c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:19.357220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:19.357915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b6406ce2-8264-4c38-9bd9-fac48bb54950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:19.360209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1321/2663] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:19 2022] DELETE /identity/v3/projects/c0d0b535e1574e5fbb7e13aa21c3614c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:19.364888 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddd6a-1a12-4071-b0b5-8e36006ca5f9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.365302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddd6a-1a12-4071-b0b5-8e36006ca5f9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.365803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddd6a-1a12-4071-b0b5-8e36006ca5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.389306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6cdddd6a-1a12-4071-b0b5-8e36006ca5f9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:19.392919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6cdddd6a-1a12-4071-b0b5-8e36006ca5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.408048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.408676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.408975 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.409248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.409888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.411530 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.422131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1343/2664] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:19.432589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.435141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.452806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5dd-c886-4588-ab25-6bf9f9b8268e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.458620 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.459231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.459507 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.459799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.460445 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.462141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.474181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1344/2665] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:19.484422 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1322/2666] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:19.496557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.498179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.498538 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.498919 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.520881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c382b-438a-4160-8a56-e0b892bc0006 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.520881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.520881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.520881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.521318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] PATH_INFO: `/v3/projects/760b09771cff43a8aa640730f9aa6e24/users/c3a52ca480f640e4850187cacb5bd16c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.521421 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:19.522389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.532218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1323/2667] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:19.536809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.547938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760b09771cff43a8aa640730f9aa6e24, user_id=c3a52ca480f640e4850187cacb5bd16c, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.558425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.558775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96319-40cb-40d2-aba2-50773719a012 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.569070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.569694 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.570053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.570331 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.571016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:19.571306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.572959 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae1ade-7cfa-420d-8358-0750ee4a33bd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.586966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1324/2668] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:19.588166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.588445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.588752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.608199 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:19.609923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.666236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1325/2669] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:19.667052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.678965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd471c-bb05-4f3c-ab52-271c17deaf3b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.684885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1345/2670] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:19 2022] PUT /identity/v3/projects/760b09771cff43a8aa640730f9aa6e24/users/c3a52ca480f640e4850187cacb5bd16c/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:19.685887 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.687614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.745942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.746650 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.746936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.747236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.747870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.750385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.753633 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:19.758915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4072b-188b-45c5-b3f2-2087f88b2880 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.764499 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.765406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.765406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.765770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.823938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.828546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653c37-16ef-4968-803a-0a8afdbdd0c2 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.834335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1346/2671] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:03:19.835639 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.836082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.836525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.854983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1326/2672] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:19.859759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.863913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:19.869733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] MFA Rules not processed for user `c3a52ca480f640e4850187cacb5bd16c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:19.870927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:19.923599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6a66-ad57-4e50-ae5a-ee093eb8a57d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.928576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.929265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.929544 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.929815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.930456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.932501 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:19.936576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1347/2673] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:19.941169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:19.951756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488819-8a81-4c9a-935d-b2447ef4272e None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:19.956751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:19.960815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:19.960815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:19.960815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:19.960815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:19.961216 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.065775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1327/2674] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:20.069774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.080392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7f7f-413a-436d-b824-43e7a54721b5 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.085106 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.085677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.085955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.086222 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.086849 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.088444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.100040 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1328/2675] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:20.104242 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.118406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1348/2676] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:19 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:20.118518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81ddfd-59af-4363-b1c3-066707bf95a9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.120936 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.184146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.184782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.185011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.185328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.186008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.187632 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.194449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229afc-c9d4-4eb5-9adc-88dbbc1be764 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.197881 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1329/2677] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:20.199691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.200290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.200565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.200953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.201597 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.202782 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.204094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.212835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a9606-d073-4a57-9e09-fe32dc9ad5e4 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.217882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.219287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.219287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.219498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] PATH_INFO: `/v3/projects/aaac3f77c0914090b6723d2a6171898d/users/9598f434963a4fdab660c0473b80b8f8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.235007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaac3f77c0914090b6723d2a6171898d, user_id=9598f434963a4fdab660c0473b80b8f8, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.237760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.290417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.296142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1349/2678] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:20.300033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.309792 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24333f-b859-438f-8ae6-0bfe5bf2754d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.315930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.317253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.317604 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.317836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.318444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.320344 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc1a76-4b85-4097-9594-97dab131fd72 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.325564 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1330/2679] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:20 2022] PUT /identity/v3/projects/aaac3f77c0914090b6723d2a6171898d/users/9598f434963a4fdab660c0473b80b8f8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:20.334162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1350/2680] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:20.335240 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.336257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.336632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.336925 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.368976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] MFA Rules not processed for user `9598f434963a4fdab660c0473b80b8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:20.370201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.399103 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.409914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6190d-dc86-4988-908b-4b942755c7ee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.414870 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.418657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.418657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.418657 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] PATH_INFO: `/v3/projects/a440f0a1824d4c67827b348559b21506/users/824f84242053437d8fde36524f3f159c/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.433577 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a440f0a1824d4c67827b348559b21506, user_id=824f84242053437d8fde36524f3f159c, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.441625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.454186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1351/2681] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:20.458554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.469531 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a5da8-b2a7-47c1-a34e-3d5f9ab59255 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.474170 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.474769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.475028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.475294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.475919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.477983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.553163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1331/2682] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:20 2022] PUT /identity/v3/projects/a440f0a1824d4c67827b348559b21506/users/824f84242053437d8fde36524f3f159c/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:20.557006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.620126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df117b5f-f48b-48cb-81eb-9427a863d6f3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.625742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.626352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.626715 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.626893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.627546 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.629195 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.640552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1332/2683] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:20.644602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.652193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1352/2684] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:20.652193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.655133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e446-8789-412a-83cb-c8413ed67308 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.716515 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.717151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.717456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.717742 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] PATH_INFO: `/v3/projects/a440f0a1824d4c67827b348559b21506/users/824f84242053437d8fde36524f3f159c/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.719684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a440f0a1824d4c67827b348559b21506, user_id=824f84242053437d8fde36524f3f159c, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.722395 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9828288-bd59-4ac7-9f7f-bed8b486005d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.727830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece6eb-f0d3-45e6-897b-3c1ec8ec7b43 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.732434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1333/2685] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:20 2022] PUT /identity/v3/projects/a440f0a1824d4c67827b348559b21506/users/824f84242053437d8fde36524f3f159c/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:20.749458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.749458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.749458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.776980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] MFA Rules not processed for user `824f84242053437d8fde36524f3f159c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:20.779668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.797175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.797175 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.802393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.802393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.802393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.802393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.812941 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.839017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.858036 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1334/2686] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:20.868313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.869753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:20.928890 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693ef8-3970-435d-b180-868c14e54c3b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.932563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.933241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.933695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.933845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1353/2687] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:20 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:20.933958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.937488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.950360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea1da-ba69-463b-a47d-5b5fe671b51c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.956100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.956725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.957027 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.957298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.957938 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.959535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:20.971196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1354/2688] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:20.975183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:20.984651 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551bbd-11fe-4a94-80c6-d36cade72427 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:20.989207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:20.989836 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:20.990115 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:20.990384 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] PATH_INFO: `/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5/users/bc63b0890e044d0fadcd15dca6034b92/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:20.993936 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:20.995386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.004364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1335/2689] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:21.006355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ce7a0f1fde4f6fa134fd4987e46be5, user_id=bc63b0890e044d0fadcd15dca6034b92, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.008196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.145117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1355/2690] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:20 2022] PUT /identity/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5/users/bc63b0890e044d0fadcd15dca6034b92/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:21.149352 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.160410 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908aff-8cb4-4a01-883d-e967ccd41586 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.224622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.225820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.225820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.226025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.226485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.228096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19f67-dd1f-4778-ac16-caf83599652c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.242534 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1336/2691] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:21.243532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.254498 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312da2f-a0cf-4e8c-8122-f8cdb2a0c306 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.259385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.260131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.260396 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.260741 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] PATH_INFO: `/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5/users/bc63b0890e044d0fadcd15dca6034b92/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.262679 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ce7a0f1fde4f6fa134fd4987e46be5, user_id=bc63b0890e044d0fadcd15dca6034b92, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.265552 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.276472 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1356/2692] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:21 2022] PUT /identity/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5/users/bc63b0890e044d0fadcd15dca6034b92/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:21.288499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.288802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.289078 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.321677 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] MFA Rules not processed for user `bc63b0890e044d0fadcd15dca6034b92`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:21.323557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:21.360682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:21.397567 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1337/2693] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:21.520092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.521823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:21.581612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5327ce-6041-48f4-8194-106513340b7c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.585334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.585846 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.586127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.586390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.595862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.597315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.613626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1357/2694] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:21.774028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:21.784406 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc0b08-0246-4f69-a45c-2d185f423e46 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:21.789333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:21.789333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:21.789333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:21.789333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:21.849982 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:21.851466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:21.861005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1338/2695] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:23.409152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:23.410577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:23.479779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4da1-73ae-4b63-9c5b-9f3a1de4fb73 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:23.484929 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:23.485614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:23.485891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:23.486156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] PATH_INFO: `/v3/users/85e2b8f6de0e4d85a403e4a471078560` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:23.487255 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e2b8f6de0e4d85a403e4a471078560)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:23.490378 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:23.683266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e2b8f6de0e4d85a403e4a471078560'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:23.685228 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:23.696066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e2b8f6de0e4d85a403e4a471078560'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:23.703534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e2b8f6de0e4d85a403e4a471078560'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:23.712988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e2b8f6de0e4d85a403e4a471078560'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:23.712988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e2b8f6de0e4d85a403e4a471078560'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:23.793815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1358/2696] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:23 2022] DELETE /identity/v3/users/85e2b8f6de0e4d85a403e4a471078560 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:24.054361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:24.066111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56745d6-83ec-4feb-a69e-664c69149355 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:24.127866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:24.128492 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.128815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.129092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] PATH_INFO: `/v3/projects/e80da941a84a48be9913a9f9f26094e7` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.130235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80da941a84a48be9913a9f9f26094e7)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:24.132146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:24.262652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80da941a84a48be9913a9f9f26094e7', 'request_id': 'req-752af4ab-46b6-4696-8cbd-039d72bb675e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:24.271186 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80da941a84a48be9913a9f9f26094e7', 'request_id': 'req-752af4ab-46b6-4696-8cbd-039d72bb675e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:24.278335 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80da941a84a48be9913a9f9f26094e7', 'request_id': 'req-752af4ab-46b6-4696-8cbd-039d72bb675e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:24.283416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:24.396414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] The token cache is being invalidate because project e80da941a84a48be9913a9f9f26094e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:24.396929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:24.404358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:24.404358 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1339/2697] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:24 2022] DELETE /identity/v3/projects/e80da941a84a48be9913a9f9f26094e7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:24.521351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:24.522888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:24.595251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a07098-1bd5-4aef-b666-535ea673a60d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:24.658097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:24.658813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:24.659149 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:24.659420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:24.661510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:24.739538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:24.741158 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2383a40-a7c6-48cd-81af-721feb5d7ab1 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:24.751578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1359/2698] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:27.006551 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:27.007989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:27.075404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752af4ab-46b6-4696-8cbd-039d72bb675e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:27.082266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:27.082920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:27.083202 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:27.083490 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] PATH_INFO: `/v3/users/9598f434963a4fdab660c0473b80b8f8` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:27.084624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9598f434963a4fdab660c0473b80b8f8)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:27.087614 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:27.251633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9598f434963a4fdab660c0473b80b8f8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:27.261231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9598f434963a4fdab660c0473b80b8f8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:27.261231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9598f434963a4fdab660c0473b80b8f8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:27.338027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9598f434963a4fdab660c0473b80b8f8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:27.338648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9598f434963a4fdab660c0473b80b8f8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:27.357419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1340/2699] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:27 2022] DELETE /identity/v3/users/9598f434963a4fdab660c0473b80b8f8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:27.367671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:27.368194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:27.368328 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:27.388180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:27.393188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:27.419704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:27.450127 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1360/2700] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:27.460609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:27.462170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:27.518958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c9a5-e2f2-4d6a-bfeb-8af52392e5eb admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:27.522634 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:27.523255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:27.523535 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:27.523809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:27.533294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:27.535898 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:27.544502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1341/2701] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:27.990218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:27.991796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:28.010630 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa768bf-4bcc-4e7d-ab87-ce3a1a6069c5 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:28.021183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:28.021812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:28.022090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:28.022359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] PATH_INFO: `/v3/projects/aaac3f77c0914090b6723d2a6171898d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:28.023673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaac3f77c0914090b6723d2a6171898d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:28.026063 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:28.133028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaac3f77c0914090b6723d2a6171898d', 'request_id': 'req-b51bea9c-ab55-40cd-a7b0-206a207c2e24'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.139168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaac3f77c0914090b6723d2a6171898d', 'request_id': 'req-b51bea9c-ab55-40cd-a7b0-206a207c2e24'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.145579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaac3f77c0914090b6723d2a6171898d', 'request_id': 'req-b51bea9c-ab55-40cd-a7b0-206a207c2e24'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.233509 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] The token cache is being invalidate because project aaac3f77c0914090b6723d2a6171898d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:28.233804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.234772 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.236527 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1361/2702] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:27 2022] DELETE /identity/v3/projects/aaac3f77c0914090b6723d2a6171898d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:28.240580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:28.251295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8302a2-7063-40fa-b5c6-42715d82ef7b service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:28.264812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:28.313552 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:28.314732 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:28.315041 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:28.315313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] PATH_INFO: `/v3/users/bc63b0890e044d0fadcd15dca6034b92` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:28.316833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc63b0890e044d0fadcd15dca6034b92)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:28.319181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:28.542703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc63b0890e044d0fadcd15dca6034b92'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.543260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc63b0890e044d0fadcd15dca6034b92'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.551155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc63b0890e044d0fadcd15dca6034b92'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.637965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc63b0890e044d0fadcd15dca6034b92'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.638707 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a103ed5c-3322-47cc-97bc-42d81f197cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc63b0890e044d0fadcd15dca6034b92'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:28.658991 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1342/2703] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:28 2022] DELETE /identity/v3/users/bc63b0890e044d0fadcd15dca6034b92 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:29.119529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.120986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:29.136235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea9c-ab55-40cd-a7b0-206a207c2e24 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.202368 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.203003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.203285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.203557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] PATH_INFO: `/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.205418 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ce7a0f1fde4f6fa134fd4987e46be5)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.207406 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:29.323007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ce7a0f1fde4f6fa134fd4987e46be5', 'request_id': 'req-598a1885-6593-4af0-a3b1-eb5646b7093c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:29.329105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ce7a0f1fde4f6fa134fd4987e46be5', 'request_id': 'req-598a1885-6593-4af0-a3b1-eb5646b7093c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:29.333692 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:29.335917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ce7a0f1fde4f6fa134fd4987e46be5', 'request_id': 'req-598a1885-6593-4af0-a3b1-eb5646b7093c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:29.400538 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] The token cache is being invalidate because project 72ce7a0f1fde4f6fa134fd4987e46be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:29.401066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:29.402049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-598a1885-6593-4af0-a3b1-eb5646b7093c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:29.403650 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1362/2704] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:29 2022] DELETE /identity/v3/projects/72ce7a0f1fde4f6fa134fd4987e46be5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:29.408745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.409304 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.409630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.431152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:29.431152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:29.493901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1343/2705] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:29.502579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.502930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.503238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.523827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:29.525074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:29.533232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1363/2706] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:29.537502 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.547159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f6548-fa35-43f5-b22d-e68882461f05 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.555123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.555123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.555123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.555123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.555642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:29.555642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.555980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:29.573695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1344/2707] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:29.584316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.604318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877b5e-78c5-47c5-b0c2-9b94a5d366ee None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.606073 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.606688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.606965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.607236 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.608024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.610000 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:29.755046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1364/2708] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:29 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:29.759404 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.770663 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84508adb-d3a7-403c-8ff3-bee36ff0c25c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.793624 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:29.839291 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.839893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.840174 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.840446 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.841121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.843060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:29.927816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1345/2709] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:29 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:29.932069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.943103 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fc88f-3e8d-4086-b5df-8aae808c61ef admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.947986 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.948693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.949040 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.949784 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.949940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.951516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:29.962268 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1365/2710] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:29.972947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:29.982999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e093-4e38-47aa-a1e4-0d1ef9b030c8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:29.988452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:29.989108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:29.989389 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:29.989664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:29.990311 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:29.991923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617905-d417-465e-838b-915c1a195ed9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.003451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1346/2711] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:30.007856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.019020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65fa-cce7-4f19-9931-2270cb0773a8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.028541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.029254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.029532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.032570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] PATH_INFO: `/v3/projects/ee853ece8a2c4fa28d9197086867dbde/users/f9ce92a3128e46518ec50856cfb2f734/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.045316 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee853ece8a2c4fa28d9197086867dbde, user_id=f9ce92a3128e46518ec50856cfb2f734, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.047952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.123999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1366/2712] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:30 2022] PUT /identity/v3/projects/ee853ece8a2c4fa28d9197086867dbde/users/f9ce92a3128e46518ec50856cfb2f734/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:30.135630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.136319 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.136470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.292015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] MFA Rules not processed for user `f9ce92a3128e46518ec50856cfb2f734`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:30.293193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:30.359417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1347/2713] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:30.364582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.430349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6161-3525-4159-9d85-5281c5cbb66d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.434964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.435563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.435843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.436117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.436791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.438698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.522962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1367/2714] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:30 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:30.527428 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.538865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455aef88-0250-450f-8fd6-30a71afda0d3 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.594977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.595603 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.595884 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.596193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.597467 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.599583 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.701845 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1348/2715] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:30 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:30.705672 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.716411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d552ed-c8df-4538-af9e-19f4b23a7308 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.720993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.722225 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.722730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.723014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.723645 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.725315 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.735635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1368/2716] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:30.740181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.751979 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e7a14-18ab-4e60-901c-4ab486541483 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.756981 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.757586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.757865 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.758132 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.758776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.760378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69d64-c4ca-47d2-9069-0ad9132b2d18 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.771153 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1349/2717] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:30.776080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:30.786786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d267d6-2740-487f-b918-5bca7b472571 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:30.791526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:30.792154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.792427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.792748 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] PATH_INFO: `/v3/projects/0409853051504fd4a13825bef87fb1b7/users/694aafefa200411483afac027bcf73e8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.814590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0409853051504fd4a13825bef87fb1b7, user_id=694aafefa200411483afac027bcf73e8, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:30.818214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:30.923433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1369/2718] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:30 2022] PUT /identity/v3/projects/0409853051504fd4a13825bef87fb1b7/users/694aafefa200411483afac027bcf73e8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:30.935361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:30.935712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:30.936047 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:30.971260 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:30.980749 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] MFA Rules not processed for user `694aafefa200411483afac027bcf73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:30.981967 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:31.056364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1350/2719] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:31.060777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.097703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:31.125744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857aee6-f1bf-4cdb-8082-c388a6897b30 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.133442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.134079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.134355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.134622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.135444 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.137484 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.266894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1370/2720] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:31 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:31.271450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.282368 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed30e3-679a-4bb5-8aa5-00a738a0918e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.345351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.345972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.346250 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.346995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.347817 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.349860 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.432460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1351/2721] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:31 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:31.436585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.448332 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c190d-a110-4da9-996d-475271fa0798 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.453082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.455631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.456621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.456931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.457586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.459180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.469892 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1371/2722] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:31.474067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.484084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28d2a-9ea4-42e3-9137-c8f37b9e6497 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.488957 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.489596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.489871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.490143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] PATH_INFO: `/v3/projects/e71a583b54a841c2b7ef106c18376996/users/94ec637a70a840eeb8dea0ed68b6aed9/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.507879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a583b54a841c2b7ef106c18376996, user_id=94ec637a70a840eeb8dea0ed68b6aed9, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.511241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.575314 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1352/2723] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:31 2022] PUT /identity/v3/projects/e71a583b54a841c2b7ef106c18376996/users/94ec637a70a840eeb8dea0ed68b6aed9/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:31.579247 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.590037 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497617b3-09d7-4a1f-b2fa-597440596c41 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.648419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.648976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.649251 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.649521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.650153 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.652005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879b917-c22f-455a-bb5b-3b810e067eff admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.662302 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1372/2724] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:31.666458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.677611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361cb4-1d6a-4631-8b48-3f172e1f2742 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.686357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.686357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.686357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.686357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] PATH_INFO: `/v3/projects/e71a583b54a841c2b7ef106c18376996/users/94ec637a70a840eeb8dea0ed68b6aed9/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.686826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a583b54a841c2b7ef106c18376996, user_id=94ec637a70a840eeb8dea0ed68b6aed9, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.687897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.698670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1353/2725] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:31 2022] PUT /identity/v3/projects/e71a583b54a841c2b7ef106c18376996/users/94ec637a70a840eeb8dea0ed68b6aed9/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:31.709067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.709607 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.710085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.738404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] MFA Rules not processed for user `94ec637a70a840eeb8dea0ed68b6aed9`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:31.739619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:31.813637 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1373/2726] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:31.825244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:31.826925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:31.889253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0191d8-169a-4adc-992c-7071755c044c admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:31.893060 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:31.894321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:31.894652 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:31.894958 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:31.902935 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:31.905217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:31.906695 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:31.916909 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1354/2727] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:33.053050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:33.054443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:33.067090 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac4be6-4dc0-4b42-98cc-2bb14a3e9bc2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:33.070753 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:33.071376 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:33.071646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:33.071908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:33.101060 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:33.131817 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:33.133314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:33.142646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1374/2728] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:38.006901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:38.016196 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a0847-28ed-48c6-8e01-64af1607aa8d service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:38.020249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:38.020882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:38.021300 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:38.021796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:38.078885 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:38.080328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c86860-d0c2-401c-b194-1efadabc9803 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:38.089255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1355/2729] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:39.829412 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:39.830880 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:39.899230 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83440cc-ac94-4522-9bb7-4d1fee837451 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:39.904220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:39.904961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:39.905243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:39.905516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] PATH_INFO: `/v3/users/c3a52ca480f640e4850187cacb5bd16c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:39.906821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a52ca480f640e4850187cacb5bd16c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:39.908873 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:40.062570 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a52ca480f640e4850187cacb5bd16c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.076044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a52ca480f640e4850187cacb5bd16c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.083409 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a52ca480f640e4850187cacb5bd16c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.084234 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a52ca480f640e4850187cacb5bd16c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.084867 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a52ca480f640e4850187cacb5bd16c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.157214 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1375/2730] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:39 2022] DELETE /identity/v3/users/c3a52ca480f640e4850187cacb5bd16c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:40.161696 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:40.162282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:40.162282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:40.182296 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:40.183498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:40.241802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1356/2731] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:40.251424 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:40.252947 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:40.307514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:40.313172 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cff3-3fcf-4645-9b38-53640bb71b56 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:40.316865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:40.317553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:40.318039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:40.318459 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:40.327334 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:40.328919 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:40.338523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1376/2732] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:40.789007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:40.790938 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:40.803220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a20e-843e-4ae5-ad67-ced0ac2da5ff None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:40.814796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:40.816026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:40.817206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:40.817206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] PATH_INFO: `/v3/projects/760b09771cff43a8aa640730f9aa6e24` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:40.818996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] RBAC: Authorizing `identity:delete_project(project_id=760b09771cff43a8aa640730f9aa6e24)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:40.821134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:40.968640 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760b09771cff43a8aa640730f9aa6e24', 'request_id': 'req-e7f462dc-b984-40f2-b881-3bf96715507a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.975028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760b09771cff43a8aa640730f9aa6e24', 'request_id': 'req-e7f462dc-b984-40f2-b881-3bf96715507a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:40.980916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760b09771cff43a8aa640730f9aa6e24', 'request_id': 'req-e7f462dc-b984-40f2-b881-3bf96715507a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.071729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] The token cache is being invalidate because project 760b09771cff43a8aa640730f9aa6e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:41.072014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.072637 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.074166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1357/2733] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:40 2022] DELETE /identity/v3/projects/760b09771cff43a8aa640730f9aa6e24 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:41.078309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:41.088712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e7e4-85af-4dd2-882d-5881298e7b34 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:41.146705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:41.147366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:41.147862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:41.148297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] PATH_INFO: `/v3/users/824f84242053437d8fde36524f3f159c` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:41.149734 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=824f84242053437d8fde36524f3f159c)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:41.152169 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:41.325677 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824f84242053437d8fde36524f3f159c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.338719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824f84242053437d8fde36524f3f159c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.345555 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824f84242053437d8fde36524f3f159c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.346258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824f84242053437d8fde36524f3f159c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.346869 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824f84242053437d8fde36524f3f159c'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:41.489007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1377/2734] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:41 2022] DELETE /identity/v3/users/824f84242053437d8fde36524f3f159c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:41.941443 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:41.945070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:41.959292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f462dc-b984-40f2-b881-3bf96715507a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:41.972570 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:42.021937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.022566 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.022843 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.023112 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] PATH_INFO: `/v3/projects/a440f0a1824d4c67827b348559b21506` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.024245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a440f0a1824d4c67827b348559b21506)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.031220 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.080258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.081715 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:42.095534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fddd9-6211-4e8d-9b93-fb16d4514f3b admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.100916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.101534 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.101816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.102089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] PATH_INFO: `/v3/users/f9ce92a3128e46518ec50856cfb2f734` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.103224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ce92a3128e46518ec50856cfb2f734)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.105182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.149499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a440f0a1824d4c67827b348559b21506', 'request_id': 'req-055699ac-8ac9-4168-abb5-272194dd577d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.155769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a440f0a1824d4c67827b348559b21506', 'request_id': 'req-055699ac-8ac9-4168-abb5-272194dd577d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.161932 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a440f0a1824d4c67827b348559b21506', 'request_id': 'req-055699ac-8ac9-4168-abb5-272194dd577d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.257382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] The token cache is being invalidate because project a440f0a1824d4c67827b348559b21506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:42.257664 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.258278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-055699ac-8ac9-4168-abb5-272194dd577d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.259813 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1358/2735] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:41 2022] DELETE /identity/v3/projects/a440f0a1824d4c67827b348559b21506 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:42.264530 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dce257-d501-408d-bea7-50376e9f14fa None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.264861 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dce257-d501-408d-bea7-50376e9f14fa None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.265129 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dce257-d501-408d-bea7-50376e9f14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.286883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c4dce257-d501-408d-bea7-50376e9f14fa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:42.288475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c4dce257-d501-408d-bea7-50376e9f14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:42.293270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ce92a3128e46518ec50856cfb2f734'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.308009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:42.309388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ce92a3128e46518ec50856cfb2f734'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.316486 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ce92a3128e46518ec50856cfb2f734'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.317224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ce92a3128e46518ec50856cfb2f734'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.317935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-03cf6ed8-5c98-4301-a509-f2bbefe295eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ce92a3128e46518ec50856cfb2f734'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:42.349360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1359/2736] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:42.357155 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.359480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.359480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.377693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:42.378907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:42.384212 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1378/2737] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:42 2022] DELETE /identity/v3/users/f9ce92a3128e46518ec50856cfb2f734 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:42.388064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1360/2738] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:42.388689 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.389028 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.389308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.391367 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.401313 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398842-d6cb-4ae0-8042-fcee2e4791a6 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.410055 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:42.411431 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:42.458283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.459079 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.459363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.459633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.460271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:42.460569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.462267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.471085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1379/2739] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:42.476934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1361/2740] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:42.478142 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.481900 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.483621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:42.487684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313f63-06d9-464e-b7f6-4d928e037188 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.492895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.493489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.493770 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.494041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.494783 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.496754 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.517923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:42.553373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a8af-ea26-46f4-832c-316367bd5c91 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.557218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.557821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.558102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.558374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.567801 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.569537 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.579398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1362/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:42.596895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1380/2742] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:42.603415 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.614184 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940a2-eff5-43ba-aeed-1aed8de536f7 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.673066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.673674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.673953 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.674225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.674918 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.677531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.776276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1363/2743] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:42.780407 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.791336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b194e9-d453-4ec6-8460-d17ba7e1ddc7 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.796744 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.797514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.797851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.798182 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.804449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.804449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.812282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1381/2744] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:42.816445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.827254 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110df0-408b-489b-a940-23c6f87e56fd admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.831897 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.832488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.832800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.833764 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.834414 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.836005 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4ba92-3e31-4644-a8a7-626013984404 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.846223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1364/2745] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:42.851253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:42.861322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf4b5-5562-4016-8c9a-fd17ee122f45 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:42.866308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:42.873239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.873239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.873239 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] PATH_INFO: `/v3/projects/ee501bc1a9214729b30942c5bf247074/users/89212b4cf52b446da2e5f6c5d6a2be3b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:42.882218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee501bc1a9214729b30942c5bf247074, user_id=89212b4cf52b446da2e5f6c5d6a2be3b, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:42.884921 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:42.982325 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1382/2746] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:42 2022] PUT /identity/v3/projects/ee501bc1a9214729b30942c5bf247074/users/89212b4cf52b446da2e5f6c5d6a2be3b/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:42.994014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:42.994489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:42.994615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.023819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] MFA Rules not processed for user `89212b4cf52b446da2e5f6c5d6a2be3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:43.024686 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:43.073830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:43.093549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1365/2747] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:43.097962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.133774 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.135188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:43.168025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf0dc4-a8f5-4da1-96b8-8a3208ac7777 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.173025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.173699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.173984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.174260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.175566 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.176877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.205803 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e671a-9cfd-4777-9b8c-a7ad7de9192e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.210856 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.211471 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.211746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.212011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] PATH_INFO: `/v3/projects/ee853ece8a2c4fa28d9197086867dbde` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.213163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee853ece8a2c4fa28d9197086867dbde)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.215121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.279250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1383/2748] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:43 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:43.283017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.293312 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:43.345904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c35ea-9bd7-416b-b6b6-da102e4f0be9 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.356639 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee853ece8a2c4fa28d9197086867dbde', 'request_id': 'req-098d5a01-d6c1-433c-a119-e4b73ea8fa39'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.363163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee853ece8a2c4fa28d9197086867dbde', 'request_id': 'req-098d5a01-d6c1-433c-a119-e4b73ea8fa39'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.369601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee853ece8a2c4fa28d9197086867dbde', 'request_id': 'req-098d5a01-d6c1-433c-a119-e4b73ea8fa39'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.402743 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.403335 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.403608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.403877 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.404480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.406617 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.446087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] The token cache is being invalidate because project ee853ece8a2c4fa28d9197086867dbde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:43.446437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.447077 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.448714 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1366/2749] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:43 2022] DELETE /identity/v3/projects/ee853ece8a2c4fa28d9197086867dbde => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:43.452523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.453848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:43.466336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5a01-d6c1-433c-a119-e4b73ea8fa39 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.471043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.471641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.471921 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.472191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] PATH_INFO: `/v3/users/694aafefa200411483afac027bcf73e8` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.473322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694aafefa200411483afac027bcf73e8)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.475796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.515066 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1384/2750] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:43 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:43.518816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.520467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:43.532847 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109373b-db26-4ef9-93cb-bff2eddde83c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.538171 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.538745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.539020 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.539287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.539915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.541545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.551603 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1385/2751] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:43.557186 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.566712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098737ed-ba79-494c-8e5e-170e014bd8b0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.571548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.577705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.577705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.577705 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] PATH_INFO: `/v3/projects/77321a99e2f94b378a4fb5ed0c379762/users/a446430070b34c1d893a0a6ffdd6e0fa/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.588556 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=77321a99e2f94b378a4fb5ed0c379762, user_id=a446430070b34c1d893a0a6ffdd6e0fa, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.591235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.700889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694aafefa200411483afac027bcf73e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.701602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694aafefa200411483afac027bcf73e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.704101 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1386/2752] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:43 2022] PUT /identity/v3/projects/77321a99e2f94b378a4fb5ed0c379762/users/a446430070b34c1d893a0a6ffdd6e0fa/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:43.707901 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.713419 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694aafefa200411483afac027bcf73e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.770086 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165b7ab-93f0-4c59-bb71-e06a3a3ddddc admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.775676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.777613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694aafefa200411483afac027bcf73e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.778184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.778432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.778700 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.779016 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-efbb675f-7048-4c66-af20-7dd3f58f9d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694aafefa200411483afac027bcf73e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:43.779361 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.780985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.790028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:43.794728 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1387/2753] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:43.796085 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:43.798009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:43.809519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1367/2754] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:43 2022] DELETE /identity/v3/users/694aafefa200411483afac027bcf73e8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:43.815666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7944eb-4d13-4bd3-9a06-bb6d12a71bb5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:43.820318 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:43.877386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:43.878048 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.878327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.878631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] PATH_INFO: `/v3/projects/77321a99e2f94b378a4fb5ed0c379762/users/a446430070b34c1d893a0a6ffdd6e0fa/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.880769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77321a99e2f94b378a4fb5ed0c379762, user_id=a446430070b34c1d893a0a6ffdd6e0fa, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:43.883494 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:43.893804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1388/2755] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:43 2022] PUT /identity/v3/projects/77321a99e2f94b378a4fb5ed0c379762/users/a446430070b34c1d893a0a6ffdd6e0fa/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:43.905177 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:43.905549 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:43.905825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:43.936144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] MFA Rules not processed for user `a446430070b34c1d893a0a6ffdd6e0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:43.937449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.010259 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1368/2756] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:44.023030 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:44.024889 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.087061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1b92-9cc1-4360-8daf-1ae2b0898466 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:44.090751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:44.091421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.091740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.092017 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.101627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:44.103094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:44.113229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1389/2757] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:44.180949 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:44.242940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a318-864c-4c8e-8c7b-f3907b7f8cc7 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:44.248471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:44.249091 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:44.249769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.250046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.250169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.250325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] PATH_INFO: `/v3/users/89212b4cf52b446da2e5f6c5d6a2be3b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.251699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89212b4cf52b446da2e5f6c5d6a2be3b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:44.254027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:44.266477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a61e5-90cf-465f-af93-cd24fca81eaf service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:44.272137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:44.272862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.272990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.273265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] PATH_INFO: `/v3/projects/0409853051504fd4a13825bef87fb1b7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.274417 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0409853051504fd4a13825bef87fb1b7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:44.276859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:44.521438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89212b4cf52b446da2e5f6c5d6a2be3b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.521747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0409853051504fd4a13825bef87fb1b7', 'request_id': 'req-6178d34e-b534-4953-99cd-65b84bddd0c2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.522348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89212b4cf52b446da2e5f6c5d6a2be3b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.528433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0409853051504fd4a13825bef87fb1b7', 'request_id': 'req-6178d34e-b534-4953-99cd-65b84bddd0c2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.529706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89212b4cf52b446da2e5f6c5d6a2be3b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.534362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0409853051504fd4a13825bef87fb1b7', 'request_id': 'req-6178d34e-b534-4953-99cd-65b84bddd0c2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.608770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89212b4cf52b446da2e5f6c5d6a2be3b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.609469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-4f402e57-0bae-4a94-be4d-9c87a69bfd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89212b4cf52b446da2e5f6c5d6a2be3b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.620579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:44.628025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1369/2758] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:44 2022] DELETE /identity/v3/users/89212b4cf52b446da2e5f6c5d6a2be3b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:44.632286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.632571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.632882 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.652108 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:44.653318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.680383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] The token cache is being invalidate because project 0409853051504fd4a13825bef87fb1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:44.680671 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.681324 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.682814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1390/2759] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:44 2022] DELETE /identity/v3/projects/0409853051504fd4a13825bef87fb1b7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:44.686843 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:44.688284 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.714110 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1370/2760] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:44.720845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:44.724403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:44.725788 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:44.756747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178d34e-b534-4953-99cd-65b84bddd0c2 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:44.765298 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:44.765922 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.766202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.766474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] PATH_INFO: `/v3/users/94ec637a70a840eeb8dea0ed68b6aed9` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.767710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ec637a70a840eeb8dea0ed68b6aed9)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:44.769673 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:44.783965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2cc1e-641c-45e4-8c1b-2cadac92d00c None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:44.788384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:44.789037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:44.789317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:44.789585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:44.798840 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:44.800287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:44.810123 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1371/2761] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:44.976982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ec637a70a840eeb8dea0ed68b6aed9'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.988480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ec637a70a840eeb8dea0ed68b6aed9'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:44.998265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ec637a70a840eeb8dea0ed68b6aed9'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.004253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ec637a70a840eeb8dea0ed68b6aed9'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.004253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ec637a70a840eeb8dea0ed68b6aed9'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.086363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1391/2762] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:44 2022] DELETE /identity/v3/users/94ec637a70a840eeb8dea0ed68b6aed9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:45.263303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.263303 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.288151 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5ab4-06cd-4cc7-809d-c7ee40baf39f service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.371520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.372156 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.372437 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.372796 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] PATH_INFO: `/v3/projects/ee501bc1a9214729b30942c5bf247074` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.373946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee501bc1a9214729b30942c5bf247074)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.376004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.468638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:45.476233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee501bc1a9214729b30942c5bf247074', 'request_id': 'req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.482424 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee501bc1a9214729b30942c5bf247074', 'request_id': 'req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.487908 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee501bc1a9214729b30942c5bf247074', 'request_id': 'req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.522310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.523951 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.539188 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49621-1c37-4de9-99dc-3df11e21826d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.566118 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] The token cache is being invalidate because project ee501bc1a9214729b30942c5bf247074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:45.568689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.568689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.569006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1372/2763] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:45 2022] DELETE /identity/v3/projects/ee501bc1a9214729b30942c5bf247074 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:45.572896 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.574328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.600916 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.601602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.601888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.602161 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] PATH_INFO: `/v3/projects/e71a583b54a841c2b7ef106c18376996` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.603314 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71a583b54a841c2b7ef106c18376996)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.605388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.642475 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2a60-3c6f-4950-a3b9-8633ab8c02f6 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.647482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.648096 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.648371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.648636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] PATH_INFO: `/v3/users/a446430070b34c1d893a0a6ffdd6e0fa` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.649825 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a446430070b34c1d893a0a6ffdd6e0fa)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.651995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.702856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:45.704049 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71a583b54a841c2b7ef106c18376996', 'request_id': 'req-0dd51294-b628-4acc-a2cf-e17f2470106d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.710201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71a583b54a841c2b7ef106c18376996', 'request_id': 'req-0dd51294-b628-4acc-a2cf-e17f2470106d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.715622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71a583b54a841c2b7ef106c18376996', 'request_id': 'req-0dd51294-b628-4acc-a2cf-e17f2470106d'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.822970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] The token cache is being invalidate because project e71a583b54a841c2b7ef106c18376996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:45.823265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.823895 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-0dd51294-b628-4acc-a2cf-e17f2470106d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.825699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1392/2764] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:45 2022] DELETE /identity/v3/projects/e71a583b54a841c2b7ef106c18376996 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:45.831428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004e7c-05c4-405f-9478-cfdc6c19c109 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.831712 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004e7c-05c4-405f-9478-cfdc6c19c109 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.831987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004e7c-05c4-405f-9478-cfdc6c19c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.852535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-f8004e7c-05c4-405f-9478-cfdc6c19c109 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:45.853810 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-f8004e7c-05c4-405f-9478-cfdc6c19c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.917058 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1393/2765] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:45.918547 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a446430070b34c1d893a0a6ffdd6e0fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.919187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a446430070b34c1d893a0a6ffdd6e0fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.925264 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.925545 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.925818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.926591 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a446430070b34c1d893a0a6ffdd6e0fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.945647 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:45.946831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:45.954701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1394/2766] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:45.959586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.969143 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496608f-4c79-495a-b0cb-6734285398e9 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:45.973782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:45.975280 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:45.975674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:45.975999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:45.976640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:45.976965 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:45.978541 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:45.983301 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a446430070b34c1d893a0a6ffdd6e0fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.984011 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a446430070b34c1d893a0a6ffdd6e0fa'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:45.990714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1395/2767] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:45.995263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:45.997031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.003188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1373/2768] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:45 2022] DELETE /identity/v3/users/a446430070b34c1d893a0a6ffdd6e0fa => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:46.011292 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7b96-b73c-4179-9dcc-89bb61eebd06 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.069982 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.070596 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.070882 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.071151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.071818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.073760 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.168100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1396/2769] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:45 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:46.172431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.182903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0b51-509b-4bd7-9df3-c404ecd7f448 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.239317 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:46.253316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.253923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.254219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.254799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.255159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.257607 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.340848 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1374/2770] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:46 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:46.346632 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.357311 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cf9f8-2e62-472b-abbf-f600d81db1d6 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.362246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.368793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.368793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.368793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.368793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.368793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.378219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1397/2771] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:46.383713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.393769 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b2dbc-4caf-45aa-8bff-a6b8f145af76 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.401189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.401189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.401189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.401189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.401746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.402752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.413520 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1375/2772] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:46.417664 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.427646 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.429421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29284a-c558-4a2e-ac79-d29af4158a33 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.429636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.434915 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.436003 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.436432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.436740 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] PATH_INFO: `/v3/projects/4781dfbff6ce4195910c28f6554607a1/users/9fa4a841af6247f4b39dc902d6c056bf/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.444895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b127b-29cd-4527-b9e1-5c1ecc42cf3d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.456360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.456360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.456360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.456360 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] PATH_INFO: `/v3/projects/77321a99e2f94b378a4fb5ed0c379762` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.457135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77321a99e2f94b378a4fb5ed0c379762)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.457253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4781dfbff6ce4195910c28f6554607a1, user_id=9fa4a841af6247f4b39dc902d6c056bf, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.457470 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.459150 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820ff0-7598-42b9-a236-cfd99fbd48c9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.618481 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1398/2773] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:46 2022] PUT /identity/v3/projects/4781dfbff6ce4195910c28f6554607a1/users/9fa4a841af6247f4b39dc902d6c056bf/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:46.623359 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.623642 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.623913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.638981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:46.645136 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:46.646449 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.654579 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77321a99e2f94b378a4fb5ed0c379762', 'request_id': 'req-9460c003-a33f-459d-b8d3-c3dadf3c1962'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.663286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77321a99e2f94b378a4fb5ed0c379762', 'request_id': 'req-9460c003-a33f-459d-b8d3-c3dadf3c1962'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.669505 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77321a99e2f94b378a4fb5ed0c379762', 'request_id': 'req-9460c003-a33f-459d-b8d3-c3dadf3c1962'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.709868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1399/2774] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:46.726261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.727610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.784055 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] The token cache is being invalidate because project 77321a99e2f94b378a4fb5ed0c379762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:46.784345 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.785007 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9460c003-a33f-459d-b8d3-c3dadf3c1962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:46.785447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384f9a-f3e5-4373-ace6-09f83077a6a8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.786517 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1376/2775] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:46 2022] DELETE /identity/v3/projects/77321a99e2f94b378a4fb5ed0c379762 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:46.789356 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.789964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.790245 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.790517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.791761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.792187 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.792300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.792820 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.806008 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.807516 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708ca9-1d3f-4708-83e6-3896a9d477af service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.815765 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:46.816994 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.819399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1400/2776] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:46.827265 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1377/2777] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:46.835229 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.835517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.836109 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.858102 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:46.859663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:46.869044 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1401/2778] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:46.873333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.883455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac4b4d-8ff6-461e-92e3-787f3c7d9ad9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.888450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.889150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.889432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.889705 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.890351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:46.890654 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.892256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:46.908334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1378/2779] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:46.909589 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:46.919535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e42126-37bf-42c5-846b-294629fd4b5a None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:46.924054 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:46.924675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:46.924974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:46.925254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:46.929394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:46.929394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.036134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1402/2780] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:47.040440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.050586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048df89-72fe-4d22-a3c4-f0009a37574e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.110481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.111149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.111427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.111699 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.112374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.114447 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.226170 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1379/2781] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:47 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:47.230278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.240797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd26c-8ff0-4bf1-b80c-9dd76da06c84 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.253942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.254568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.254850 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.255125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.256463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.258249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.268973 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1403/2782] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:47.274064 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.284988 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe435bd6-87f9-4e7e-b021-28db659279a8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.289899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.290575 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.290864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.291136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.291975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.294143 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71046bcc-0405-4a2b-a630-3f4f18708f79 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.306095 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1380/2783] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:47.311010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.322159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea0b7-9b1a-425f-9871-4aaee3cff40d admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.327308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.328097 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.328382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.328917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] PATH_INFO: `/v3/projects/88ebb0e3f8b3415794690405591f2f17/users/50e5cc00c75e4492893f1b8b33e5c52f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.350618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ebb0e3f8b3415794690405591f2f17, user_id=50e5cc00c75e4492893f1b8b33e5c52f, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.353874 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.426360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1404/2784] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:47 2022] PUT /identity/v3/projects/88ebb0e3f8b3415794690405591f2f17/users/50e5cc00c75e4492893f1b8b33e5c52f/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:47.437762 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.438281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.438281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.452217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:47.467799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] MFA Rules not processed for user `50e5cc00c75e4492893f1b8b33e5c52f`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:47.469214 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:47.535349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1381/2785] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:47.540733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.589827 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:47.604616 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f5595-9a06-4582-af2e-d1c6d4aa1e68 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.609382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.609964 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.613202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.613202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.613202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.613202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.723770 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.726580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:47.736452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1405/2786] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:47 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:47.737640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.740889 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d97a-faf2-48e0-af14-f5a229d99aa5 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.807999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.808623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.808929 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.809244 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] PATH_INFO: `/v3/users/b6ed4048ec7f4c5783892bd3d86aff61` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.810386 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ed4048ec7f4c5783892bd3d86aff61)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.810917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104db2c-0efd-4f50-809d-a58de7f96624 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.812346 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.815624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.816223 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.816493 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.816790 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.817414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.820220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.909387 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1406/2787] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:47 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:47.913813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.923619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612eae-33c0-4613-a456-bd61b4198673 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.929022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.929634 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.929908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.930177 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.930848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.932420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.942257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1407/2788] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:47.946373 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:47.957954 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ffb7a-a0c8-4942-b4cd-fa7f4d5d61ba admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:47.963439 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:47.964254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:47.964985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:47.964985 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] PATH_INFO: `/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2/users/45439ca30711485091634f2eab4584e2/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:47.982714 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7589b92c90e343f08c4d3e6ee0cd63a2, user_id=45439ca30711485091634f2eab4584e2, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:47.985872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea404f-cdf5-4520-9ce7-98122b7eac75 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:47.990295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ed4048ec7f4c5783892bd3d86aff61'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.991227 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ed4048ec7f4c5783892bd3d86aff61'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:47.998761 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ed4048ec7f4c5783892bd3d86aff61'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.053662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1408/2789] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:47 2022] PUT /identity/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2/users/45439ca30711485091634f2eab4584e2/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:48.054719 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0cc8-0e25-434f-ba06-72580be71c7d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.055005 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0cc8-0e25-434f-ba06-72580be71c7d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.055289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0cc8-0e25-434f-ba06-72580be71c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.083906 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ed4048ec7f4c5783892bd3d86aff61'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.084569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ed4048ec7f4c5783892bd3d86aff61'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.085984 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-cfbf0cc8-0e25-434f-ba06-72580be71c7d None None] MFA Rules not processed for user `9fa4a841af6247f4b39dc902d6c056bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:48.087270 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cfbf0cc8-0e25-434f-ba06-72580be71c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.108276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1382/2790] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:47 2022] DELETE /identity/v3/users/b6ed4048ec7f4c5783892bd3d86aff61 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:48.109747 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.111305 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.136431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:48.164408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1409/2791] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:48.164408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.164408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.164408 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.184293 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:48.185610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.189231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f93fa-f98a-4357-9c98-6d6297393e8a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.193860 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1410/2792] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:48.197006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.197006 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.199066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.199737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.199999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.200266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.201006 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.202859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.213217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6cce9-668a-4ac4-9c70-6924c264fef8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.214403 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1383/2793] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:48.215002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.216592 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.218092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.218699 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.218952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.219219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.219905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.221812 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.228816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:48.275690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9792-b4e6-4812-aa58-68efd5f6a7d1 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.279621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.280216 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.280493 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.280790 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.289916 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.291387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.300777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1384/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:48.301609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.311525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0dbd-7668-4ef7-8ea3-f2b1e401b63b service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.316886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1411/2795] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:48.317171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.317573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.317939 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.318276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] PATH_INFO: `/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2/users/45439ca30711485091634f2eab4584e2/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.319290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.320613 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7589b92c90e343f08c4d3e6ee0cd63a2, user_id=45439ca30711485091634f2eab4584e2, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.323371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c9b0-53ff-4d26-8044-cb6697c3856f admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.334648 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1385/2796] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:48 2022] PUT /identity/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2/users/45439ca30711485091634f2eab4584e2/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:48.347593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.348283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.348283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.377453 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] MFA Rules not processed for user `45439ca30711485091634f2eab4584e2`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:48.378726 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.388482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7957e1-6596-4965-9ea8-b9bc7f5101fe admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.448987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.449519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.449796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.450069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.450691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.456027 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1386/2797] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:48.456480 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.464638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.467383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.498380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:48.536267 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345e881-b2a3-4983-8c56-b0034e70a1da None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.540400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.541038 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.541316 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.541585 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.551032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.552539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.562478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1387/2798] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:03:48.575897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1412/2799] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:48 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:48.580466 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.593659 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649a23-9a51-40ba-908d-2a652552ab76 service cinder] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.598850 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.599998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.600275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.600542 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.601228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.602835 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.616976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1388/2800] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:48.623682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.635452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8543ad2-bc91-4a40-9dfa-98b1790a06e5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.641069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.641782 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.642123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.642400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] PATH_INFO: `/v3/projects/fb46db0fd6214033bb5401df88cbe52b/users/2f6fdb94280d4057b39aa604fef729f6/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.658819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46db0fd6214033bb5401df88cbe52b, user_id=2f6fdb94280d4057b39aa604fef729f6, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.662881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.746104 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.748008 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:48.764171 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599dca-87e4-4954-be33-09867d19fe09 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.769431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.770275 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.770752 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.771545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] PATH_INFO: `/v3/projects/d8bc4e56bd2a4aa0aebc5ee07dce343b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.773052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bc4e56bd2a4aa0aebc5ee07dce343b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.775235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.781932 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1413/2801] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:48 2022] PUT /identity/v3/projects/fb46db0fd6214033bb5401df88cbe52b/users/2f6fdb94280d4057b39aa604fef729f6/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:48.784548 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.869980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5460b2-6d63-4cbf-ad68-b0ce676e5200 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.874890 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.875567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.875851 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.876122 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.876963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.878568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.879974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:48.890403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1414/2802] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:48.894793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:48.905393 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be38fb-2828-4b59-b743-38ba6eff3a04 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:48.910354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:48.910988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:48.911267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:48.911685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] PATH_INFO: `/v3/projects/fb46db0fd6214033bb5401df88cbe52b/users/2f6fdb94280d4057b39aa604fef729f6/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:48.913872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46db0fd6214033bb5401df88cbe52b, user_id=2f6fdb94280d4057b39aa604fef729f6, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:48.916575 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:48.926799 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1415/2803] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:48 2022] PUT /identity/v3/projects/fb46db0fd6214033bb5401df88cbe52b/users/2f6fdb94280d4057b39aa604fef729f6/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:48.965815 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bc4e56bd2a4aa0aebc5ee07dce343b', 'request_id': 'req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.972525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bc4e56bd2a4aa0aebc5ee07dce343b', 'request_id': 'req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:48.978374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bc4e56bd2a4aa0aebc5ee07dce343b', 'request_id': 'req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:49.031799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] The token cache is being invalidate because project d8bc4e56bd2a4aa0aebc5ee07dce343b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:49.032251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:49.032937 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:49.037087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1389/2804] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:48 2022] DELETE /identity/v3/projects/d8bc4e56bd2a4aa0aebc5ee07dce343b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:49.649367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.651354 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:49.718904 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ecee-d009-4289-bd45-36bf96d1b6e8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.779091 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45439ca30711485091634f2eab4584e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7589b92c90e343f08c4d3e6ee0cd63a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.779701 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.780009 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.780285 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.780981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:49.781288 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.782962 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.794955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1416/2805] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:49.799496 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.810965 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2023-7d6d-44b1-b01c-2ddfa01516c8 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.815449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45439ca30711485091634f2eab4584e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7589b92c90e343f08c4d3e6ee0cd63a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.816049 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.816336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.816609 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.817274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.822085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:49.920434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1390/2806] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:49 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:49.921194 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:49.931436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93abc-f5c2-4ae5-9e64-53e63d7eb01b tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:49.989010 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45439ca30711485091634f2eab4584e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7589b92c90e343f08c4d3e6ee0cd63a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:49.989635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:49.990178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:49.990500 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:49.991138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:49.991441 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:49.993218 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73977be-f2f1-46c5-b0f1-115929c0393c tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:50.006180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1417/2807] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 15:03:50.044807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:50.055337 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffe63-5007-4eea-96c4-4e8153ffbc11 tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:50.059914 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45439ca30711485091634f2eab4584e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7589b92c90e343f08c4d3e6ee0cd63a2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:50.060526 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:50.060837 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:50.061111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] PATH_INFO: `/v3/projects/7d5c52a7bc724ddf88ba2282690ba599` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:50.062235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d5c52a7bc724ddf88ba2282690ba599)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:50.064126 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:50.189272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5c52a7bc724ddf88ba2282690ba599', 'request_id': 'req-9001c72d-0304-4180-b217-8c7241b8789a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:50.201822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:50.202024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:50.202151 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:50.204540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5c52a7bc724ddf88ba2282690ba599', 'request_id': 'req-9001c72d-0304-4180-b217-8c7241b8789a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:50.212069 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5c52a7bc724ddf88ba2282690ba599', 'request_id': 'req-9001c72d-0304-4180-b217-8c7241b8789a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:50.232002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] MFA Rules not processed for user `2f6fdb94280d4057b39aa604fef729f6`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:50.233260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.238559 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:50.292706 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] The token cache is being invalidate because project 7d5c52a7bc724ddf88ba2282690ba599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:50.293053 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:50.298721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-9001c72d-0304-4180-b217-8c7241b8789a tempest-VolumeQuotaClassesTest-831041046 tempest-VolumeQuotaClassesTest-831041046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:50.298721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1391/2808] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:50 2022] DELETE /identity/v3/projects/7d5c52a7bc724ddf88ba2282690ba599 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:50.307803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1418/2809] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:03:50.320693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:50.321092 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:50.334621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:50.334621 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:50.341576 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] MFA Rules not processed for user `9fa4a841af6247f4b39dc902d6c056bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:50.342895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.398811 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1392/2810] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:50.414290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:50.415920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.505327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddd0c-3b2e-4a3a-8407-4caaaaed6e22 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:50.505327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:50.505327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:50.505327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:50.506471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:50.506471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:50.516830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:50.518410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101865c-b390-42b7-8a2b-73de2bc67ce0 service nova] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:50.529287 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1419/2811] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:51.029963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:51.031349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:51.098058 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff0714-9872-4d2c-ae6b-01ccb8a23cf8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:51.102623 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:51.103241 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:51.103521 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:51.103793 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] PATH_INFO: `/v3/users/50e5cc00c75e4492893f1b8b33e5c52f` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:51.104995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e5cc00c75e4492893f1b8b33e5c52f)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:51.106920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:51.298285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e5cc00c75e4492893f1b8b33e5c52f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:51.299019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e5cc00c75e4492893f1b8b33e5c52f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:51.306294 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e5cc00c75e4492893f1b8b33e5c52f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:51.389017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e5cc00c75e4492893f1b8b33e5c52f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:51.389568 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e5cc00c75e4492893f1b8b33e5c52f'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:51.408417 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1393/2812] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:51 2022] DELETE /identity/v3/users/50e5cc00c75e4492893f1b8b33e5c52f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:51.413646 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:51.414125 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:51.414240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:51.432997 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:51.434202 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:51.492907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1420/2813] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:51.502605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:51.503995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:51.536111 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:51.564022 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7d00b-e0a7-45fa-b76b-8bbbdbb218ee admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:51.568287 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:51.568925 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:51.569203 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:51.569474 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:51.578543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:51.579975 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:51.590035 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1394/2814] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:52.038310 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:52.039539 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:52.051935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf97843-004d-4e49-9fa1-24412aca44fd None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:52.057079 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:52.057704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:52.057981 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:52.058252 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] PATH_INFO: `/v3/projects/88ebb0e3f8b3415794690405591f2f17` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:52.059404 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ebb0e3f8b3415794690405591f2f17)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:52.061425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:52.087474 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:52.164320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ebb0e3f8b3415794690405591f2f17', 'request_id': 'req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.170465 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ebb0e3f8b3415794690405591f2f17', 'request_id': 'req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.177278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ebb0e3f8b3415794690405591f2f17', 'request_id': 'req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.278751 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] The token cache is being invalidate because project 88ebb0e3f8b3415794690405591f2f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:52.279064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.279884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.284517 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1421/2815] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:52 2022] DELETE /identity/v3/projects/88ebb0e3f8b3415794690405591f2f17 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:52.285795 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:52.296449 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb656-5756-419c-ae6e-d795453ad3e8 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:52.361276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:52.361895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:52.362173 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:52.362440 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] PATH_INFO: `/v3/users/45439ca30711485091634f2eab4584e2` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:52.363545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45439ca30711485091634f2eab4584e2)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:52.365556 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:52.554384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45439ca30711485091634f2eab4584e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.555031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45439ca30711485091634f2eab4584e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.561920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45439ca30711485091634f2eab4584e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.648734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45439ca30711485091634f2eab4584e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.652690 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-acde5436-9dd8-4bad-967a-8ea7fe58a014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45439ca30711485091634f2eab4584e2'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:52.668562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1395/2816] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:52 2022] DELETE /identity/v3/users/45439ca30711485091634f2eab4584e2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:53.153513 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.154974 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:53.170698 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91081-bd70-4b97-bad4-d9539cb1b2d3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.232608 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.233250 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.233528 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.233797 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] PATH_INFO: `/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.234924 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7589b92c90e343f08c4d3e6ee0cd63a2)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.237056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.330779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7589b92c90e343f08c4d3e6ee0cd63a2', 'request_id': 'req-f2e7bdc6-c502-4529-81e0-cbc14e61af77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.337258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7589b92c90e343f08c4d3e6ee0cd63a2', 'request_id': 'req-f2e7bdc6-c502-4529-81e0-cbc14e61af77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.343166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7589b92c90e343f08c4d3e6ee0cd63a2', 'request_id': 'req-f2e7bdc6-c502-4529-81e0-cbc14e61af77'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.391207 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] The token cache is being invalidate because project 7589b92c90e343f08c4d3e6ee0cd63a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:53.391585 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.392266 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-f2e7bdc6-c502-4529-81e0-cbc14e61af77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:53.393905 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1422/2817] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:53 2022] DELETE /identity/v3/projects/7589b92c90e343f08c4d3e6ee0cd63a2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:53.398872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.399380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.399553 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.419743 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:53.421093 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:53.470525 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:53.488234 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1396/2818] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:53.497930 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.498208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.498485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.521963 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:53.523547 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:53.532688 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1423/2819] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:53.537580 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.549682 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec819e1d-455a-4c98-9fbc-2cbe97a523aa None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.558630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.559767 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.560045 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.560347 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.561043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:53.562913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.563037 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.577189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1397/2820] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:53.582031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.591644 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff30d-b7df-4a85-a64a-7e71a07b3ff8 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.596337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.596972 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.597246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.597514 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.598152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.600152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.759253 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1424/2821] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:53 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:53.763509 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.773674 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831620-f8d3-45aa-8e4f-c17832d56d38 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.832533 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.833083 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.833363 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.833630 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.834298 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.836633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.930434 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1398/2822] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:53 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:53.934235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.944565 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a223-4c43-435d-b1fc-a93982528ea5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.950191 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.950791 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.951069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.951338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.951977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.953654 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:53.965897 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1425/2823] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:53.970233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:53.982193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae89e88-1165-4057-a11c-d87f4734db05 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:53.987622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:53.988350 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:53.989351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:53.989351 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:53.989670 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:53.991893 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7f6e7-1e55-4a96-912e-2ee36b331bbb admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.009355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1399/2824] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:54.010600 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.016088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.022340 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88c9b-337e-431b-83ac-6238ab45dbd4 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.027583 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.028382 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.028845 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.029184 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] PATH_INFO: `/v3/projects/22ec23e95ff54dcc9da780b6560ca381/users/daed8702c350407ab0e354d1a7371301/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.044120 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ec23e95ff54dcc9da780b6560ca381, user_id=daed8702c350407ab0e354d1a7371301, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.046980 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.138674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1426/2825] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:54 2022] PUT /identity/v3/projects/22ec23e95ff54dcc9da780b6560ca381/users/daed8702c350407ab0e354d1a7371301/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:54.149014 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.152838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.152838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.178831 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] MFA Rules not processed for user `daed8702c350407ab0e354d1a7371301`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:54.181468 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.243366 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1400/2826] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:54.247894 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.314162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed566a-eb11-4dad-b3de-9e879c24d6e8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.321137 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.321747 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.322029 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.322299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] PATH_INFO: `/v3/projects` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.322943 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.324878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.405953 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1427/2827] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:54.409871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.421357 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165f46-3761-4b6b-bda9-daae0ff14946 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.466124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.485431 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.486102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.491573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.491573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] PATH_INFO: `/v3/users` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.491573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.491573 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.568810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1401/2828] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:54.574816 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.589278 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c24b2-6204-4939-8dcb-57d1c120296c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.594631 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.595248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.595525 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.595795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.596432 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.598117 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.610141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1428/2829] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:03:54.614481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.625043 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61af4-2f59-4a8d-a520-27e22e0a32d2 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.629794 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.630405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.630681 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.630951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] PATH_INFO: `/v3/projects/a404021982784c13ab324d6ef2d12382/users/474069c8dbb8472891cc92fbf4474ab7/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.647846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a404021982784c13ab324d6ef2d12382, user_id=474069c8dbb8472891cc92fbf4474ab7, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.651209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.741378 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1402/2830] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:54 2022] PUT /identity/v3/projects/a404021982784c13ab324d6ef2d12382/users/474069c8dbb8472891cc92fbf4474ab7/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:54.745563 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.755599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b546a-a5ec-4d45-8a78-a89aece06ac8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.816976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.817587 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.817868 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.818141 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.818825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.820440 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97386528-6f7a-4bd6-962d-81a896694e02 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.833626 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1429/2831] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:54.835523 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.845911 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961818d0-d3fb-471f-b9c4-e226bbad3188 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:54.851605 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:54.852327 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.852775 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.853057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] PATH_INFO: `/v3/projects/a404021982784c13ab324d6ef2d12382/users/474069c8dbb8472891cc92fbf4474ab7/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.859818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a404021982784c13ab324d6ef2d12382, user_id=474069c8dbb8472891cc92fbf4474ab7, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:54.859818 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:54.868061 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1403/2832] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:54 2022] PUT /identity/v3/projects/a404021982784c13ab324d6ef2d12382/users/474069c8dbb8472891cc92fbf4474ab7/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:54.878307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:54.878443 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:54.878691 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:54.908326 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] MFA Rules not processed for user `474069c8dbb8472891cc92fbf4474ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:54.909568 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:54.949733 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.980180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1430/2833] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:54.991763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:54.993966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:55.058080 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddd19-fedc-402c-9997-b2acd6ff925a admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.061842 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.062545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.062819 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.063114 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.074777 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.076408 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcccb8-573a-4fa6-ab6b-d71b302b3bdf service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.086341 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1404/2834] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:55.632322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:55.696529 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b9fe-825e-4da5-ba48-e3be1c2cc7c2 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:55.701067 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:55.701681 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:55.701952 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:55.702231 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] PATH_INFO: `/v3/users/daed8702c350407ab0e354d1a7371301` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:55.703320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daed8702c350407ab0e354d1a7371301)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:55.705296 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:55.906992 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daed8702c350407ab0e354d1a7371301'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:55.920884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daed8702c350407ab0e354d1a7371301'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:55.928598 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daed8702c350407ab0e354d1a7371301'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:55.929526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daed8702c350407ab0e354d1a7371301'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:55.930168 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daed8702c350407ab0e354d1a7371301'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.006822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1431/2835] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:55 2022] DELETE /identity/v3/users/daed8702c350407ab0e354d1a7371301 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:03:56.011665 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.012191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.012362 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.033499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:56.034719 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.095059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1405/2836] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:56.105665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.107082 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.169011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac60d05-3fef-449f-978a-694cc86275d3 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.173420 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.174061 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.174338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.174610 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.182669 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:56.185211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.186745 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.197624 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1432/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:03:56.639693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.641172 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:56.654059 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80342c3-cd7b-4e5b-8b91-328f6919b349 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.658751 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.659361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.659638 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.659913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] PATH_INFO: `/v3/projects/22ec23e95ff54dcc9da780b6560ca381` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.661082 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ec23e95ff54dcc9da780b6560ca381)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.663595 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:56.757444 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:56.766797 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ec23e95ff54dcc9da780b6560ca381', 'request_id': 'req-ee9a254d-6004-4663-bafc-fda28e2fd27d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.773102 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ec23e95ff54dcc9da780b6560ca381', 'request_id': 'req-ee9a254d-6004-4663-bafc-fda28e2fd27d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.779074 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ec23e95ff54dcc9da780b6560ca381', 'request_id': 'req-ee9a254d-6004-4663-bafc-fda28e2fd27d'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.862248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] The token cache is being invalidate because project 22ec23e95ff54dcc9da780b6560ca381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:56.862539 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.863142 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:56.864625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1406/2838] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:56 2022] DELETE /identity/v3/projects/22ec23e95ff54dcc9da780b6560ca381 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:56.869615 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:56.879249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463ddb-379e-4e8f-ae33-e6cb73518113 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:56.935323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:56.935942 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:56.936219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:56.936488 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] PATH_INFO: `/v3/users/474069c8dbb8472891cc92fbf4474ab7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:56.937649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] RBAC: Authorizing `identity:delete_user(user_id=474069c8dbb8472891cc92fbf4474ab7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:56.939622 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:57.105224 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474069c8dbb8472891cc92fbf4474ab7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.122765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474069c8dbb8472891cc92fbf4474ab7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.129665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474069c8dbb8472891cc92fbf4474ab7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.130348 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474069c8dbb8472891cc92fbf4474ab7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.131016 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e09f6fcb-e99a-4adb-967c-6075cb96271a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474069c8dbb8472891cc92fbf4474ab7'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.199804 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1433/2839] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:03:56 2022] DELETE /identity/v3/users/474069c8dbb8472891cc92fbf4474ab7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:57.630560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:57.632962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:57.652276 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a254d-6004-4663-bafc-fda28e2fd27d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:57.713400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:57.714032 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:57.714309 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:57.714581 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] PATH_INFO: `/v3/projects/a404021982784c13ab324d6ef2d12382` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:57.715759 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a404021982784c13ab324d6ef2d12382)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:57.717702 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:57.829821 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a404021982784c13ab324d6ef2d12382', 'request_id': 'req-43f34765-b348-4e05-ba79-7ef14c6f4a9b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.836416 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a404021982784c13ab324d6ef2d12382', 'request_id': 'req-43f34765-b348-4e05-ba79-7ef14c6f4a9b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.842333 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a404021982784c13ab324d6ef2d12382', 'request_id': 'req-43f34765-b348-4e05-ba79-7ef14c6f4a9b'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.929511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] The token cache is being invalidate because project a404021982784c13ab324d6ef2d12382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:03:57.929807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.932085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-43f34765-b348-4e05-ba79-7ef14c6f4a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:03:57.932085 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1407/2840] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:03:57 2022] DELETE /identity/v3/projects/a404021982784c13ab324d6ef2d12382 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:57.937886 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e304-934e-479d-9951-8f3890054eea None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:57.938448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e304-934e-479d-9951-8f3890054eea None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:57.938448 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e304-934e-479d-9951-8f3890054eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:57.959300 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-1601e304-934e-479d-9951-8f3890054eea None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:57.960779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-1601e304-934e-479d-9951-8f3890054eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:58.019357 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1434/2841] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:58.081266 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.081557 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.081836 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.101445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:58.102661 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:58.110519 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1408/2842] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:58.114798 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e304-934e-479d-9951-8f3890054eea None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.125961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e304-934e-479d-9951-8f3890054eea None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.130561 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.131834 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.132217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.132586 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.133557 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:03:58.133977 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.135800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.151395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1435/2843] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:03:58.152516 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.161985 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0c17b-3d2c-4e6e-b9ab-203f84fda113 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.167456 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.167993 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.168273 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.168545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.169211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.171122 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.296491 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1409/2844] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:03:58 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:03:58.300496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.306696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:58.311878 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0d0e-3c8e-414b-b18c-7e9a1496b5d8 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.367389 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.367988 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.368263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.368532 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.369195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.371100 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.458110 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1436/2845] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:03:58 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:03:58.459489 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.472099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1b99e-085e-4248-b02a-e4f738a0e29d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.477691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.478432 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.478711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.478983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.479643 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.481348 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.492593 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1410/2846] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:58.496526 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.506765 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67608-dfc7-466b-bc86-f012102c9ac5 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.511819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.512492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.513031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.513263 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.513779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.515374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e78de-4bfb-47a3-88b0-a7b82982927c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.527710 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1437/2847] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:03:58.531824 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.542278 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e439351-44d0-4bd6-b1c8-6c22339d2124 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.547024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.547683 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.553380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.553380 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] PATH_INFO: `/v3/projects/2effe510f6d843df8b5ec203e45a3670/users/0a0c7888d12a406ea19a576f687ea9a8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.560594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:58.564531 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2effe510f6d843df8b5ec203e45a3670, user_id=0a0c7888d12a406ea19a576f687ea9a8, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.567253 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.635834 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1411/2848] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:03:58 2022] PUT /identity/v3/projects/2effe510f6d843df8b5ec203e45a3670/users/0a0c7888d12a406ea19a576f687ea9a8/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:03:58.645769 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.646050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.646323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.673578 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] MFA Rules not processed for user `0a0c7888d12a406ea19a576f687ea9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:03:58.674796 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:58.742059 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1438/2849] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:03:58.750219 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:03:58.751891 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:03:58.810872 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43aa08-e2fb-4ff6-a0b9-900f34e40d89 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:03:58.814584 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:03:58.815181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:03:58.815455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:03:58.815723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:03:58.824760 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:03:58.826192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:03:58.835157 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1412/2850] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:04.360410 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:04.362160 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:04.422377 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e449577-7b27-4d93-8b8a-f822ac2ca2b0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:04.426917 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:04.427717 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:04.427993 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:04.428259 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:04.430107 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:04.457831 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:04.498392 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:04.499848 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:04.510580 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1439/2851] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:08.830912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:14.514260 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=18 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:19.639374 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:19.640855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:19.786390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315399-7c72-4f28-968d-ebd822849f1a service glance] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:19.791604 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:19.792947 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:19.793228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:19.793499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:19.797541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:19.807452 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:19.809499 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49e03-f83c-42eb-9fbe-e8e1bcaf52b2 service placement] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:19.819745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1413/2852] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:23.549708 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:23.660301 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711f42-6d88-485d-83d9-0314206e4b77 service cinder] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:23.665193 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:23.666089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.666089 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.666297 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] PATH_INFO: `/v3/users/0a0c7888d12a406ea19a576f687ea9a8` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.667276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0c7888d12a406ea19a576f687ea9a8)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:23.670033 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:23.825313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0c7888d12a406ea19a576f687ea9a8'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:23.837041 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0c7888d12a406ea19a576f687ea9a8'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:23.844759 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0c7888d12a406ea19a576f687ea9a8'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:23.845458 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0c7888d12a406ea19a576f687ea9a8'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:23.846056 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0c7888d12a406ea19a576f687ea9a8'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:23.923577 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1440/2853] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:23 2022] DELETE /identity/v3/users/0a0c7888d12a406ea19a576f687ea9a8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:23.934162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:23.934162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:23.934162 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:23.969283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:23.970488 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:24.029809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1414/2854] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:24.039635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.040690 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:24.086818 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:24.102129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b604d-31d1-41ca-b661-9177ad3fba63 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.105801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.106478 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.106891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.107180 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.120865 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.123196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.134240 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1441/2855] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:24.555942 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:24.557312 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:24.568571 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=100 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:24.572507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492971e-bd8c-4c54-b673-b57161c810d9 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:24.578590 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:24.579498 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:24.579685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:24.579963 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] PATH_INFO: `/v3/projects/2effe510f6d843df8b5ec203e45a3670` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:24.581158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2effe510f6d843df8b5ec203e45a3670)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:24.583135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:24.718559 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2effe510f6d843df8b5ec203e45a3670', 'request_id': 'req-7306562a-9f39-4ed5-ade7-7c323102f777'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:24.724711 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2effe510f6d843df8b5ec203e45a3670', 'request_id': 'req-7306562a-9f39-4ed5-ade7-7c323102f777'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:24.730326 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2effe510f6d843df8b5ec203e45a3670', 'request_id': 'req-7306562a-9f39-4ed5-ade7-7c323102f777'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:24.834867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] The token cache is being invalidate because project 2effe510f6d843df8b5ec203e45a3670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:24.834867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:24.834867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:24.834867 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1415/2856] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:24 2022] DELETE /identity/v3/projects/2effe510f6d843df8b5ec203e45a3670 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:28.146104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:28.147590 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:28.161885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed5b4-55e0-4f6f-8c5b-6a8eefbe360a service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:28.219425 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:28.219967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:28.220299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:28.220588 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] PATH_INFO: `/v3/users/9fa4a841af6247f4b39dc902d6c056bf` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:28.221837 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa4a841af6247f4b39dc902d6c056bf)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:28.223900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:28.464286 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa4a841af6247f4b39dc902d6c056bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.478220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa4a841af6247f4b39dc902d6c056bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.485991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa4a841af6247f4b39dc902d6c056bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.490197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa4a841af6247f4b39dc902d6c056bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.490197 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa4a841af6247f4b39dc902d6c056bf'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.565685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1442/2857] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:28 2022] DELETE /identity/v3/users/9fa4a841af6247f4b39dc902d6c056bf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:28.806833 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:28.808284 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:28.822019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306562a-9f39-4ed5-ade7-7c323102f777 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:28.882977 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:28.883601 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:28.883913 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:28.884183 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] PATH_INFO: `/v3/projects/4781dfbff6ce4195910c28f6554607a1` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:28.885339 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4781dfbff6ce4195910c28f6554607a1)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:28.887802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:28.984983 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4781dfbff6ce4195910c28f6554607a1', 'request_id': 'req-b0fed359-2969-4538-be60-ba30b9a048f3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.991209 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4781dfbff6ce4195910c28f6554607a1', 'request_id': 'req-b0fed359-2969-4538-be60-ba30b9a048f3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:28.997001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4781dfbff6ce4195910c28f6554607a1', 'request_id': 'req-b0fed359-2969-4538-be60-ba30b9a048f3'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.081507 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] The token cache is being invalidate because project 4781dfbff6ce4195910c28f6554607a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:29.081745 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.082361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.083852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1416/2858] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:28 2022] DELETE /identity/v3/projects/4781dfbff6ce4195910c28f6554607a1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:29.087966 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:29.091104 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:29.102902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71990-c94f-48d4-96aa-da70e0a4511e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:29.159546 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:29.160221 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:29.160421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:29.160716 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] PATH_INFO: `/v3/users/2f6fdb94280d4057b39aa604fef729f6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:29.161829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6fdb94280d4057b39aa604fef729f6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:29.163737 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:29.165210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:29.336786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6fdb94280d4057b39aa604fef729f6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.350434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6fdb94280d4057b39aa604fef729f6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.357489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6fdb94280d4057b39aa604fef729f6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.358198 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6fdb94280d4057b39aa604fef729f6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.358800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-e7f59fdd-5559-4031-bddf-0b8f6bef9b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6fdb94280d4057b39aa604fef729f6'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.422381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1443/2859] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:29 2022] DELETE /identity/v3/users/2f6fdb94280d4057b39aa604fef729f6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:29.675737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:29.675737 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:29.688412 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed359-2969-4538-be60-ba30b9a048f3 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:29.702895 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:29.747723 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:29.748349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:29.748633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:29.748934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] PATH_INFO: `/v3/projects/fb46db0fd6214033bb5401df88cbe52b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:29.750076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb46db0fd6214033bb5401df88cbe52b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:29.752001 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:29.861189 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb46db0fd6214033bb5401df88cbe52b', 'request_id': 'req-a960ebeb-ca38-418d-bb14-5e8650a188e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.867511 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb46db0fd6214033bb5401df88cbe52b', 'request_id': 'req-a960ebeb-ca38-418d-bb14-5e8650a188e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.873763 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb46db0fd6214033bb5401df88cbe52b', 'request_id': 'req-a960ebeb-ca38-418d-bb14-5e8650a188e8'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.954615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] The token cache is being invalidate because project fb46db0fd6214033bb5401df88cbe52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:29.954903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.955528 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-a960ebeb-ca38-418d-bb14-5e8650a188e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:29.957046 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1417/2860] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:29 2022] DELETE /identity/v3/projects/fb46db0fd6214033bb5401df88cbe52b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:29.961898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:29.962206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:29.962463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.012983 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:30.014162 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:30.072011 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1444/2861] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:30.079691 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.079972 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.080243 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.100067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:30.101292 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:30.109838 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1418/2862] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:30.113908 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.124069 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a077-4d37-4bbf-aa43-42e6331177aa None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.128678 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.129261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.129533 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.129800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.130436 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:30.130731 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.132308 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.143884 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1445/2863] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:30.147969 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.158004 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2fbf-3486-4f5d-a08a-9ae6496bd84d None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.162622 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.163206 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.163486 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.163753 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.164377 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.166302 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.261017 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1419/2864] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:30 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:30.263898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.274403 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff75f7-27ba-443b-801f-cf905f683fe4 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.315064 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:30.331807 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.332434 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.332757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.333031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.333653 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.335579 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.442217 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1446/2865] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:30 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:30.446342 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.457089 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2aea-7526-46a8-bc0e-795f560d4e0b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.461802 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.462393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.462672 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.462940 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.463611 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.465286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.475285 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1420/2866] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:30.479098 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.489452 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9312e-4fac-4b3d-8adb-cbb8cf63e42e admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.494031 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.494612 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.494885 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.495152 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.495778 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.498050 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67426-37ed-4934-9929-cf44817cf2b9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.508471 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1447/2867] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:30.512669 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.522596 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0d1ec-c6af-4c5f-8be4-a0cd60af27fe admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.527548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.528185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.528469 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.528778 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] PATH_INFO: `/v3/projects/ee7852ad166647f0ada4845dd4746d47/users/b465fea04d014261b1e83917e2b46a40/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.543245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7852ad166647f0ada4845dd4746d47, user_id=b465fea04d014261b1e83917e2b46a40, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.546463 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.665179 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1421/2868] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:30 2022] PUT /identity/v3/projects/ee7852ad166647f0ada4845dd4746d47/users/b465fea04d014261b1e83917e2b46a40/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:30.676138 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.676421 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.676726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.707002 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] MFA Rules not processed for user `b465fea04d014261b1e83917e2b46a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:30.708211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:30.771821 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1448/2869] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:30.783668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.785390 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:30.834223 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:30.845295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcbcf4-0d94-475d-88a6-056666d207a9 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.848999 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.849608 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.849879 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.850146 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.859364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.860830 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76106ed-829c-41f7-9854-b7d32d20b796 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:30.869907 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1422/2870] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:30.892320 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:30.954907 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85e625-de02-4cc1-b9c9-80a36e6deced None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:30.959510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:30.960124 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:30.960398 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:30.960684 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] PATH_INFO: `/v3/users/b465fea04d014261b1e83917e2b46a40` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:30.961813 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b465fea04d014261b1e83917e2b46a40)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:30.963729 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.100640 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b465fea04d014261b1e83917e2b46a40'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.104961 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:31.113360 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b465fea04d014261b1e83917e2b46a40'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.119898 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b465fea04d014261b1e83917e2b46a40'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.120976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b465fea04d014261b1e83917e2b46a40'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.121317 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b465fea04d014261b1e83917e2b46a40'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.196046 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1449/2871] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:30 2022] DELETE /identity/v3/users/b465fea04d014261b1e83917e2b46a40 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:31.200832 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472310-d401-4698-b4c8-79c55901f38b None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.201121 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472310-d401-4698-b4c8-79c55901f38b None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.201400 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472310-d401-4698-b4c8-79c55901f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.222503 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-42472310-d401-4698-b4c8-79c55901f38b None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:31.223744 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-42472310-d401-4698-b4c8-79c55901f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.284218 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1423/2872] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:31.294693 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:31.296080 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.374447 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c9071-b732-4833-875d-fd819110f6c0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:31.378108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:31.378703 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.378990 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.379248 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.388931 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:31.390362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6a5df-3a66-44ca-91c9-fd39583fc150 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.399756 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1450/2873] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:31.833116 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42472310-d401-4698-b4c8-79c55901f38b None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:31.835124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-42472310-d401-4698-b4c8-79c55901f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:31.847960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42472310-d401-4698-b4c8-79c55901f38b None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:31.852754 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:31.853455 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:31.853799 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:31.854133 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] PATH_INFO: `/v3/projects/ee7852ad166647f0ada4845dd4746d47` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:31.855318 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7852ad166647f0ada4845dd4746d47)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:31.857755 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:31.983599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7852ad166647f0ada4845dd4746d47', 'request_id': 'req-da11abff-2e53-4fc8-ae95-8b9c59d43541'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.989910 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7852ad166647f0ada4845dd4746d47', 'request_id': 'req-da11abff-2e53-4fc8-ae95-8b9c59d43541'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:31.995411 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7852ad166647f0ada4845dd4746d47', 'request_id': 'req-da11abff-2e53-4fc8-ae95-8b9c59d43541'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.067019 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] The token cache is being invalidate because project ee7852ad166647f0ada4845dd4746d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:32.067315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.067934 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-da11abff-2e53-4fc8-ae95-8b9c59d43541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:32.069482 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1424/2874] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:31 2022] DELETE /identity/v3/projects/ee7852ad166647f0ada4845dd4746d47 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:32.074554 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.075349 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.075618 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.095934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:32.097147 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:32.155201 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1451/2875] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:32.162927 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.163286 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.163741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.183299 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:32.185066 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:32.193145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1425/2876] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:32.197210 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.207727 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd1d1f-9ab5-4604-9979-e48e938ee5b7 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.212463 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.213128 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.213390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.213662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.214337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:32.214635 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.216385 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.228711 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1452/2877] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:32.232989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.242246 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6237be-8ac6-4ffe-951c-f738632daf14 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.247776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.248361 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.248642 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.248946 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.249586 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.251481 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.354733 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1426/2878] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:32 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:32.359265 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.369383 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96f8c-8508-4e8d-9227-ab574c529285 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.408832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:32.427668 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.428204 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.428476 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.428775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.429394 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.431289 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.503022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1453/2879] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:32 2022] POST /identity/v3/users => generated 281 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:32.507175 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.517649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafc6d-1c31-46d9-956e-06c0a70bc677 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.522405 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.522996 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.523272 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.523540 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.524181 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.525822 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.536130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1427/2880] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:32.539989 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.550619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818cba-3e65-4e8d-8036-b94730268441 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.555492 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.556075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.556351 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.556621 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.557282 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.558900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f1941-5f49-43f6-83d8-a1c6c3b3b16b admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.569375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1454/2881] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:32.573393 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.583735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8a475-df3e-48e5-8d24-5b975620c787 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.588325 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.589015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.589293 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.589562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] PATH_INFO: `/v3/projects/232956718d0c498db6d3c7a6bac44d1d/users/a8e5fe29c16b4fa28ad173795d3533f2/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.603962 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=232956718d0c498db6d3c7a6bac44d1d, user_id=a8e5fe29c16b4fa28ad173795d3533f2, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.607506 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.696478 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1428/2882] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:32 2022] PUT /identity/v3/projects/232956718d0c498db6d3c7a6bac44d1d/users/a8e5fe29c16b4fa28ad173795d3533f2/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:32.707183 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.707503 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.707803 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.735515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] MFA Rules not processed for user `a8e5fe29c16b4fa28ad173795d3533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:32.736726 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:32.801446 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1455/2883] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:32.834995 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:32.836757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:32.847125 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:32.916056 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fff58-b41f-47e5-a4c1-f605471c98ef admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:32.920057 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:32.920644 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:32.920951 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:32.921225 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:32.929859 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:32.931288 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5846769-dae1-48a6-b5da-507f22a026ee service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:32.941134 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1429/2884] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:32.957299 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.019775 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a93b6-8d8d-4ee3-a0c3-4c40156712a1 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.024304 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.024934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.025211 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.025482 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] PATH_INFO: `/v3/users/a8e5fe29c16b4fa28ad173795d3533f2` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.026872 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e5fe29c16b4fa28ad173795d3533f2)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.028829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.221094 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e5fe29c16b4fa28ad173795d3533f2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.222875 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:33.233511 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e5fe29c16b4fa28ad173795d3533f2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.240219 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e5fe29c16b4fa28ad173795d3533f2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.240928 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e5fe29c16b4fa28ad173795d3533f2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.241523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e5fe29c16b4fa28ad173795d3533f2'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.314131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1456/2885] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:32 2022] DELETE /identity/v3/users/a8e5fe29c16b4fa28ad173795d3533f2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:33.318545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.319025 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.319135 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.337926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:33.339127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.398617 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1430/2886] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:33.408576 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.410038 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.466830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64e14f-3df3-441f-b947-135ef0c466e9 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.470553 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.471195 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.471419 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.471685 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.480485 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.482428 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bcc2d-3836-4372-8e7c-847a6d8d6c63 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.491662 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1457/2887] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:33.878136 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:33.879565 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:33.893529 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73434-9b3a-4d09-8c42-000eed85bcba None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:33.898233 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:33.898853 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:33.899127 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:33.899398 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] PATH_INFO: `/v3/projects/232956718d0c498db6d3c7a6bac44d1d` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:33.901295 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232956718d0c498db6d3c7a6bac44d1d)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:33.903915 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:33.979382 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232956718d0c498db6d3c7a6bac44d1d', 'request_id': 'req-358b394b-75a4-459b-845f-c18e1df9aac1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.986391 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232956718d0c498db6d3c7a6bac44d1d', 'request_id': 'req-358b394b-75a4-459b-845f-c18e1df9aac1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:33.991948 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232956718d0c498db6d3c7a6bac44d1d', 'request_id': 'req-358b394b-75a4-459b-845f-c18e1df9aac1'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.055574 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] The token cache is being invalidate because project 232956718d0c498db6d3c7a6bac44d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:34.055792 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.056460 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-358b394b-75a4-459b-845f-c18e1df9aac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:34.058002 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1431/2888] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:33 2022] DELETE /identity/v3/projects/232956718d0c498db6d3c7a6bac44d1d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:34.063111 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.063400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.063676 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.083411 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:34.084619 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.142902 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1458/2889] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:34.207384 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.207658 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.207926 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.228385 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:34.229594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.238355 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1432/2890] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:34.242515 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.253336 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77341e3-06b8-4a73-8439-5413c2f9d1ab None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.257806 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.258395 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.258666 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.258934 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.259573 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:34.259870 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.261521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.273108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1459/2891] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:34.277693 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.287087 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54fc25-1bfd-462d-9a2d-fcf789c53d5e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.291688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.292271 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.292548 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.292846 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.294211 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.296094 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.300480 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:34.429997 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1433/2892] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/projects => generated 397 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:34.434257 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.444338 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919c0c4-b77c-461d-830e-5eef03f18ac0 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.495077 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:34.501131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.501735 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.502007 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.502274 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.502891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.504825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.585371 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1460/2893] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:34.589625 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.607062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86796a-75e3-4aa6-a2ed-4e8de22cd2bc admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.611771 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.612392 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.612688 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.612998 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.613649 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.615248 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.625610 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1434/2894] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:34.632358 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.642524 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555752a-7d72-4aa3-92dd-2a0ab0a0da67 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.647159 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.647955 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.648272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.648832 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.649536 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.651914 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad6010-0a50-4eeb-8af0-f494674f80d8 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.663323 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1461/2895] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:34.667364 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.678201 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd97fac-eb4d-4a2c-b996-32ec794d813d admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.682826 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.683451 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.683736 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.684213 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] PATH_INFO: `/v3/projects/ecb6764cc4cd473884c4ad0036c59aed/users/acd9f830a5574d818604215a56e40617/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.698773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb6764cc4cd473884c4ad0036c59aed, user_id=acd9f830a5574d818604215a56e40617, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.701786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.773731 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1435/2896] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:34 2022] PUT /identity/v3/projects/ecb6764cc4cd473884c4ad0036c59aed/users/acd9f830a5574d818604215a56e40617/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:34.784862 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.785146 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.785415 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.813281 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] MFA Rules not processed for user `acd9f830a5574d818604215a56e40617`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:34.814496 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.878095 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1462/2897] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 15:04:34.889971 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:34.892193 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:34.954712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84936050-7d95-4cd4-aff5-27d7233e9cda admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:34.959984 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '136f5fbf04ab4000b0c80f1955f6515b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:34.960806 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:34.961145 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:34.961510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:34.971757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:34.973290 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57a495-e26f-4a68-856f-9de7845dcd06 service cinder] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:34.982572 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1436/2898] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:04:40.851039 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:40.912462 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00272877-3d6a-49b1-b953-a23cb19238e6 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:40.916937 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:40.917542 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:40.917815 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:40.918081 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] PATH_INFO: `/v3/users/acd9f830a5574d818604215a56e40617` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:40.919178 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd9f830a5574d818604215a56e40617)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:40.921830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:41.158946 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd9f830a5574d818604215a56e40617'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:41.171473 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd9f830a5574d818604215a56e40617'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:41.173581 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:41.178927 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd9f830a5574d818604215a56e40617'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:41.179665 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd9f830a5574d818604215a56e40617'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:41.180269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd9f830a5574d818604215a56e40617'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:41.258510 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1463/2899] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:04:40 2022] DELETE /identity/v3/users/acd9f830a5574d818604215a56e40617 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:41.262989 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:41.263627 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:41.263741 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:41.283615 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:41.284864 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:41.342666 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1437/2900] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:41.352220 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:41.353611 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:41.410757 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395ee8f-9a2c-4759-b40f-8447615ea413 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:41.414246 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:41.414839 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:41.415112 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:41.415386 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:41.424939 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:41.426367 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebec36-3dce-4dab-9cfe-0c73dbeaa829 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:41.436364 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1464/2901] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:41.865169 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:41.866698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:41.880188 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82d4b-a827-48eb-a9be-fbd910f47aea None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:41.886062 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:41.886729 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:41.887010 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:41.887281 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] PATH_INFO: `/v3/projects/ecb6764cc4cd473884c4ad0036c59aed` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:41.889028 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb6764cc4cd473884c4ad0036c59aed)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:41.891228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:41.993438 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:41.994647 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb6764cc4cd473884c4ad0036c59aed', 'request_id': 'req-110100e8-460d-4019-9704-6a2c64b9dc5a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:42.001379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb6764cc4cd473884c4ad0036c59aed', 'request_id': 'req-110100e8-460d-4019-9704-6a2c64b9dc5a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:42.006966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb6764cc4cd473884c4ad0036c59aed', 'request_id': 'req-110100e8-460d-4019-9704-6a2c64b9dc5a'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:42.075485 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] The token cache is being invalidate because project ecb6764cc4cd473884c4ad0036c59aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:04:42.075804 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:42.076487 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-110100e8-460d-4019-9704-6a2c64b9dc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:04:42.078026 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1438/2902] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:04:41 2022] DELETE /identity/v3/projects/ecb6764cc4cd473884c4ad0036c59aed => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:42.083276 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.083795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.083795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.105032 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:42.106238 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:42.165940 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1465/2903] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:42.174439 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.174757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.175029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.194245 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:42.195450 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:42.203960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1439/2904] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:42.208167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.218652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e99328-b907-48d7-9f4e-1aa104ce8629 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.223206 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.223795 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.224074 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.224346 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] PATH_INFO: `/v3/domains` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.225025 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 15:04:42.225327 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.226944 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.239294 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1466/2905] 10.222.0.13 () {58 vars in 1153 bytes} [Tue Aug 30 15:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 15:04:42.243641 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.253015 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2efe9-feff-45ce-ae0d-26fed3be7adc None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.257712 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.258321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.258598 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.258863 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.259562 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.261545 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.351866 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1440/2906] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:42.355957 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.366062 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616e3f-aba6-467e-9605-74ad151e4118 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.422337 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.422935 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.423208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.423477 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.424375 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.426322 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.502190 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1467/2907] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:42 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:42.506152 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.517445 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b157167-c16f-4787-af0c-9ca8c2a78957 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.522076 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.532800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.532800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.532800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.532800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.532800 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.536543 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1441/2908] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:04:42.540467 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.547105 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:42.550933 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21855eab-dcb2-4aa8-9294-5b5f4475117f admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.555567 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.556154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.556433 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.556732 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.557366 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.558991 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b624efd-65b9-4fd6-b994-b68bbe72db7d admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.570092 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1468/2909] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:42.574158 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.585735 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecd5af-6154-413c-98d8-65bd83259e6b admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.590599 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.591320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.591678 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.592124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] PATH_INFO: `/v3/projects/d660a07e80284e1fabd86ca67951599d/users/8908adf5e1ec406395768114a66e9c9e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.608075 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d660a07e80284e1fabd86ca67951599d, user_id=8908adf5e1ec406395768114a66e9c9e, role_id=e5ba61aaa9cc43ccbaa9e9b83874443b)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.610773 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.665249 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1442/2910] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:42 2022] PUT /identity/v3/projects/d660a07e80284e1fabd86ca67951599d/users/8908adf5e1ec406395768114a66e9c9e/roles/e5ba61aaa9cc43ccbaa9e9b83874443b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:04:42.672243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8946-af4a-4f72-aeef-c50583bc735e None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.672523 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8946-af4a-4f72-aeef-c50583bc735e None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.672819 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8946-af4a-4f72-aeef-c50583bc735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.692582 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-649e8946-af4a-4f72-aeef-c50583bc735e None None] MFA Rules not processed for user `34c5f40ca7234d1bbbf4ac2eff849e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:42.693802 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-649e8946-af4a-4f72-aeef-c50583bc735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:42.752853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1469/2911] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:42.762231 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:42.764283 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:42.822334 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692109d2-8834-486d-a0bf-fd04f1996ccd admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:42.826099 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:42.826912 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:42.827185 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:42.827454 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:42.836228 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:42.837684 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:42.847809 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1443/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:47.934388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:47.934801 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:47.934967 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:47.964362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] MFA Rules not processed for user `8908adf5e1ec406395768114a66e9c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:47.965521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:48.037830 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1470/2913] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:48.042282 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.052387 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be7d3-9939-4f8a-b006-bddde2a5dab8 service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.057124 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.057713 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.057990 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.058280 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.058901 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.060903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.198976 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1444/2914] 10.222.0.13 () {60 vars in 1153 bytes} [Tue Aug 30 15:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 15:04:48.200022 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.211814 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5154868-e417-40c5-8921-82ef9b0a7d0d None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.269088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.269614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.269891 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.270166 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] PATH_INFO: `/v3/users` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.270789 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.272779 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.359786 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1471/2915] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Aug 30 15:04:48 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 15:04:48.363776 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.375328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09803e2-0d3d-41ff-b9e2-7b3169eedc5e admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.380215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.380858 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.381215 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.381399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.382052 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.383668 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.395563 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1445/2916] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 15:04:48.399808 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.411945 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cf0f-f840-4a0d-b62d-475093e6bf6c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.417034 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.417829 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.418108 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.418381 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] PATH_INFO: `/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7/users/7b3de03799c44c97bd17c4ed1e19eb10/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.430702 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:48.434704 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6029e11b28974d4b97e9a4aaa6b0d6c7, user_id=7b3de03799c44c97bd17c4ed1e19eb10, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.437652 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.491014 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1472/2917] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:48 2022] PUT /identity/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7/users/7b3de03799c44c97bd17c4ed1e19eb10/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:48.495063 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.505235 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76010d-e935-4aee-b69f-f84e717e7b02 admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.548510 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:48.568495 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.569144 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.569725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.569725 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.570427 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.572029 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978dc4-ce1e-4a3e-a5c9-9c18e1ee4ecf admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.584698 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1446/2918] 10.222.0.13 () {58 vars in 1122 bytes} [Tue Aug 30 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 15:04:48.588823 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:48.600682 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3202e-bd18-46df-9a4c-b5b5b1207329 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:48.605628 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:48.606277 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] REQUEST_METHOD: `PUT` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:48.607329 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:48.607913 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] PATH_INFO: `/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7/users/7b3de03799c44c97bd17c4ed1e19eb10/roles/fa1cadcbfee74ff2bacf6eff22482dc6` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:48.610675 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6029e11b28974d4b97e9a4aaa6b0d6c7, user_id=7b3de03799c44c97bd17c4ed1e19eb10, role_id=fa1cadcbfee74ff2bacf6eff22482dc6)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:48.613849 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:48.626309 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1473/2919] 10.222.0.13 () {60 vars in 1483 bytes} [Tue Aug 30 15:04:48 2022] PUT /identity/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7/users/7b3de03799c44c97bd17c4ed1e19eb10/roles/fa1cadcbfee74ff2bacf6eff22482dc6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 15:04:53.759560 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868441-d453-4ace-b6b2-39c678933aaf None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:53.760084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868441-d453-4ace-b6b2-39c678933aaf None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:53.760239 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868441-d453-4ace-b6b2-39c678933aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:53.792067 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-f5868441-d453-4ace-b6b2-39c678933aaf None None] MFA Rules not processed for user `7b3de03799c44c97bd17c4ed1e19eb10`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:53.793336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-f5868441-d453-4ace-b6b2-39c678933aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:53.871966 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1447/2920] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:04:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:53.885290 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:53.887013 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:53.948134 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7078d-8dc2-4fc9-ba22-03f695d5870c admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:53.951918 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8125d6e3bd74258be79e477260a977b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:53.952521 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:53.952840 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:53.953363 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:54.016416 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:54.017920 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:54.028249 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1474/2921] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:04:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:04:54.369786 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba08df-f103-4e35-9b8f-3d19772135b3 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:54.370070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba08df-f103-4e35-9b8f-3d19772135b3 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:54.370734 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba08df-f103-4e35-9b8f-3d19772135b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:54.402097 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-38ba08df-f103-4e35-9b8f-3d19772135b3 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:04:54.403236 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-38ba08df-f103-4e35-9b8f-3d19772135b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:54.468522 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1448/2922] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 15:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:04:54.666380 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:04:54.667764 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:04:54.749241 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77022d43-9c68-45e6-a020-83eab6d387e2 service glance] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:04:54.755024 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:04:54.755627 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:04:54.755900 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:04:54.756167 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:04:54.766787 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:04:54.768390 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c488f8-4a59-421a-b14b-02edcde5c4c3 service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:04:54.777649 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1475/2923] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:05:04.461823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=76 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:04.469746 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:04.470033 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:04.470308 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:04.489031 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] MFA Rules not processed for user `8908adf5e1ec406395768114a66e9c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:04.490330 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:04.497871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1449/2924] 10.222.0.13 () {58 vars in 958 bytes} [Tue Aug 30 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:04.774135 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=89,keystone:INSERT=2 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:08.093254 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] REQUEST_METHOD: `POST` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:08.093842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:08.094442 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:08.115116 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.auth.core [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:05:08.116313 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:05:08.123999 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1476/2925] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Aug 30 15:05:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:05:08.136636 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:08.149379 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1efbac-c81d-4be2-995d-c7da0980d3f8 None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:08.155255 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:08.155871 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:08.156349 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:08.156616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:08.165274 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:08.166855 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:08.175877 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1450/2926] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:05:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:05:18.109535 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=3 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:18.172899 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=9 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:32.280075 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:05:32.333696 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43957d-bf4e-4bc6-b022-646ceb1ac2b0 None None] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:05:32.337113 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:05:32.337697 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:05:32.337970 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:05:32.338235 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:05:32.347859 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:05:32.349307 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:05:32.358489 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1477/2927] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:05:42.354427 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=26 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:07.382689 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:07.392149 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299ea6-5f70-41a5-8274-ed0cdbac4b5c service swift] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:07.395808 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:07.396402 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:07.396703 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:07.396980 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:07.398687 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:07.480685 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:07.482117 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:07.502812 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1451/2928] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:08.698267 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:08.707663 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040fc63-1eb8-4382-98be-eb317ed80001 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:08.711306 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:08.711881 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:08.712154 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:08.712422 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:08.714156 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:08.727738 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:08.729181 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:08.740599 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1478/2929] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:17.500320 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=43 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:18.735165 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=6 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:49.425569 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:49.427256 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:49.448115 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674302d-dbbd-45b8-8f77-6b35b59bd5da service neutron] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:49.456458 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '200f4c80511443c4bc7315a450a917e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:49.457518 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:49.458373 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:49.458903 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:49.462616 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:49.493810 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:49.495192 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c467881-03c4-4cba-8a05-6b914a20d549 service nova] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:49.507371 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1452/2930] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 15:06:49.574258 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:49.583564 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb794d-8d2d-4e50-a860-36f9a2ccbab5 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:49.587232 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a1375198434203bce21325c7b82c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:49.587822 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:49.588096 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:49.588362 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:49.591123 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:49.602414 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:49.603853 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:49.613400 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1479/2931] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:06:58.557757 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] REQUEST_METHOD: `POST` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:58.558191 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:58.558315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:58.608024 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.auth.core [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] MFA Rules not processed for user `02588426fad84b17a81e738bafdac8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 15:06:58.609258 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:06:58.626828 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1453/2932] 10.222.0.13 () {58 vars in 967 bytes} [Tue Aug 30 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 15:06:58.667811 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:06:58.690145 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ebd-3842-41f7-bdc1-5ad046e3c9f2 service neutron] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:06:58.695272 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285d5d20968a4dfe9c764fd09cc4ed4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:06:58.695856 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] REQUEST_METHOD: `GET` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:06:58.696131 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:06:58.696399 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:06:58.704388 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:06:58.706196 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:06:58.714088 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1480/2933] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Aug 30 15:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 15:07:06.863051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:06.928315 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9747-79ef-461d-9cda-ee988e45d73e None None] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:06.932923 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:06.933541 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:06.933816 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:06.934084 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] PATH_INFO: `/v3/users/8908adf5e1ec406395768114a66e9c9e` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:06.935212 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8908adf5e1ec406395768114a66e9c9e)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:06.937163 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:07.130150 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8908adf5e1ec406395768114a66e9c9e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.130823 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8908adf5e1ec406395768114a66e9c9e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.138070 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8908adf5e1ec406395768114a66e9c9e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.201594 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8908adf5e1ec406395768114a66e9c9e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.202217 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8908adf5e1ec406395768114a66e9c9e'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.219978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1454/2934] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:07:06 2022] DELETE /identity/v3/users/8908adf5e1ec406395768114a66e9c9e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:07.460730 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:07.471269 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d4f3a-7e3d-405d-b582-9758cd98b09b service swift] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:07.528520 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:07.529173 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:07.529453 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:07.529725 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] PATH_INFO: `/v3/projects/d660a07e80284e1fabd86ca67951599d` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:07.530842 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d660a07e80284e1fabd86ca67951599d)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:07.532777 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:07.644519 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd660a07e80284e1fabd86ca67951599d', 'request_id': 'req-9c046661-3195-43a1-ab52-79c511046913'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.650767 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd660a07e80284e1fabd86ca67951599d', 'request_id': 'req-9c046661-3195-43a1-ab52-79c511046913'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.656602 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd660a07e80284e1fabd86ca67951599d', 'request_id': 'req-9c046661-3195-43a1-ab52-79c511046913'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.724374 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] The token cache is being invalidate because project d660a07e80284e1fabd86ca67951599d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:07:07.724593 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.725261 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.726750 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1481/2935] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:07:07 2022] DELETE /identity/v3/projects/d660a07e80284e1fabd86ca67951599d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:07.730920 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:07.732328 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:07:07.745992 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff238cf-efdc-49c5-ab3e-9a5c418a02ca admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:07.770978 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:07.804955 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:07.805602 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:07.805883 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:07.806166 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] PATH_INFO: `/v3/users/7b3de03799c44c97bd17c4ed1e19eb10` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:07.807321 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3de03799c44c97bd17c4ed1e19eb10)` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:07.809306 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:07.978960 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3de03799c44c97bd17c4ed1e19eb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.979600 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3de03799c44c97bd17c4ed1e19eb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:07.986383 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3de03799c44c97bd17c4ed1e19eb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.050721 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3de03799c44c97bd17c4ed1e19eb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.051344 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.notifications [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3de03799c44c97bd17c4ed1e19eb10'} {{(pid=93237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.069322 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1455/2936] 10.222.0.13 () {58 vars in 1224 bytes} [Tue Aug 30 15:07:07 2022] DELETE /identity/v3/users/7b3de03799c44c97bd17c4ed1e19eb10 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:08.321614 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Authenticating user token {{(pid=93238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:07:08.323487 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.fernet_utils [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:07:08.337888 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046661-3195-43a1-ab52-79c511046913 admin admin] Validating token access rules against request {{(pid=93238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:07:08.407674 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:08.415825 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c5f40ca7234d1bbbf4ac2eff849e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a0fcacff99247a7a086913fb4245dc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:07:08.416793 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:07:08.417208 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:07:08.421605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] PATH_INFO: `/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7` {{(pid=93238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:07:08.421605 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6029e11b28974d4b97e9a4aaa6b0d6c7)` {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:07:08.422243 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] RBAC: Authorization granted {{(pid=93238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:07:08.536976 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6029e11b28974d4b97e9a4aaa6b0d6c7', 'request_id': 'req-70984a6a-e657-42c8-8ea8-2ff6be169c75'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.543129 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6029e11b28974d4b97e9a4aaa6b0d6c7', 'request_id': 'req-70984a6a-e657-42c8-8ea8-2ff6be169c75'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.548987 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6029e11b28974d4b97e9a4aaa6b0d6c7', 'request_id': 'req-70984a6a-e657-42c8-8ea8-2ff6be169c75'} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.627072 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] The token cache is being invalidate because project 6029e11b28974d4b97e9a4aaa6b0d6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 15:07:08.627355 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.628800 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG keystone.notifications [None req-70984a6a-e657-42c8-8ea8-2ff6be169c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 15:07:08.630402 dv-cinder-828807-5-smb devstack@keystone.service[93238]: [pid: 93238|app: 0|req: 1482/2937] 10.222.0.13 () {58 vars in 1233 bytes} [Tue Aug 30 15:07:08 2022] DELETE /identity/v3/projects/6029e11b28974d4b97e9a4aaa6b0d6c7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 15:07:18.065527 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:18.623855 dv-cinder-828807-5-smb devstack@keystone.service[93238]: DEBUG dbcounter [-] [93238] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:20.611159 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Authenticating user token {{(pid=93237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 15:09:20.612633 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:09:20.681904 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee22a0-a900-4299-b925-fca2f39bcabf admin admin] Validating token access rules against request {{(pid=93237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 15:09:20.739251 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cc82482a04e7a9ac920fd7da98e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f410872d0c7b4ad59392be785ee1076b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 15:09:20.739852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] REQUEST_METHOD: `GET` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 15:09:20.740130 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] SCRIPT_NAME: `/identity` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 15:09:20.740399 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 15:09:20.742807 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.fernet_utils [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 15:09:20.753852 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 15:09:20.755425 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462be2b-6390-420b-adae-0d68012a3a5c service placement] RBAC: Authorization granted {{(pid=93237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 15:09:20.765336 dv-cinder-828807-5-smb devstack@keystone.service[93237]: [pid: 93237|app: 0|req: 1456/2938] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Aug 30 15:09:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 15:09:30.761051 dv-cinder-828807-5-smb devstack@keystone.service[93237]: DEBUG dbcounter [-] [93237] Writing DB stats keystone:SELECT=58 {{(pid=93237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}